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rS4^ SYSTEM AND METHOD FOR DETERMINING CHANGE BETWEEN TWO 
SNi^^OTS Z TRANSMITTING THE CHANGE TO DESTINATION SNAPSHOT 

(57)Abstract: 

PROBLEM TO BE SOLVED: To enhance versatility and 
utility of a snapshot duplication means. 
SOLUTION: A system and a method are for performing 
remote asynchronous duplication, namely, mirroring of 
change of source file system snapshots to a duplicated 
file system at a destination by identifying a block 
changed by difference of block volume numbers 
identified in the case of scanning a logical file block 
index of each snapshot by utilizing scan (by a scanner) 
of blocks constituting two versions of snapshots of the 
source file system. A tree of the block regarding the file 
is checked, a pointer without changes between versions , 
is bypassed and proceeded downward and changes of | f 
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hierarchy of trees are identified and the changes are transmitted to a destination mirror 
^ZTa 6uZ^<^ snapshot. At the destination, the destination snapshot is update by 
I™^^^^^^^^ Every deleted or changed .node already existing on the dest.nat.on .s 
rjnlrr^^^^^^^^^^^ directory, namely, "momentary" directory and when it .s reused, .t .s 

re-linked with the reconstructed duplicated snapshot directory. 
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)P 2004-3S928 A 2004,2,5 

•V*"/ 

v-7^±<r>r-^rv yi^ (f.)tmM. jI' - r i5 ♦ t « m ^ MM t , 52:56 ±<o f - / d y 

y -> 3 h ,51 CJ^frlE^ 2 tf!) X t / •> a h f'- / 13 -y <Of^S )W - 7'c/:)^'S: 
C ) mlia?Q^±</-)^^.4'mie^M ? •Ca^'t « ^t t i: . 

"3: ^ V X T o 

^ ^ t , ^H<^>'> V > «; J. - A •/ o t * o t -f /-syx t o o 

D v i^^JtJ&t^*7-tV ]-t;*^,Jg3:}l-Cl'^-S>-'G •;'iM.l|I^L.-Cilgyt;&. tt^.«l<D 20 

1 CO •> 7^. r A o 
[ll>ttiI6] 

m^thS-htzmtii nod e<7>«-^«^ 1 <0.'<--:^'3 >'c^)l?l.lui5tt«>/t3 y ^Kc^j^ifc 
ttffl^/^-CIt^t^S. i n 0 d c- "7-*-*? (bt^i^tf^ S^:® 4 ii^J'-Xr 

[ ^ 

ma i n o d e 7- * - iifl2^fl:*j|2* L, imit^T- ^ ^ h ij - A (;/-?v ^r- ^; 

;^rAo 

iirsa V - 7 7 -f ;v V r A i iilS^fi^ v r 'f v';^ r A t (7)r^60^'fbt Ri#i-^i(2;?g»'J 
[a>l^il9l 
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10 



1 1 <^*{feo 

^UTmmm%r^*}^-'^y 7 ^'i-v- ^.-f aj^j<oq tree *^tf , fi^« 1 4 <o:b 

&o 30 

r«8« ; Uks*g*s*^i4i^t-^«^- * ^.v fir 
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. - • " a^ 3P 2004- : A. ,2004,2,5 

10 0 0 1] 

;^^?§{J 7 7 -f ^ f ^ ffl f - ^' <o£«l^ I?? t . S¥ L < iiJiPg^sCmJiflff scm 
[0 0 0 21 

i-^> i^SO 4^ f^l «5 7 r 1 1 -C 3 *i & o 

7 T .? « - k {^y^ryh/^- /sMtfiOffilRSEJlK-mo -Cijfti-«> J; ^ ? ^> l-Bfi^ 

^ ti ^(7> 7 ^ T y N 7 T ^ 7 - ^<^-9- ^ ^■'-h i^i&m $ it c 7 7 jv u T -b 7v t:- 

^ ^ J: 0 o r o c_ or)f^g & . ^' ^ -f T y h ti: > fi^m*^ ^ ^ v N • - 
..ii.^>M;y^^. ?^Sd-A;i.^'JT^.' (LAN) . "7 -f K ^ J .^-y h 

VPN) '^h'^'y^^-'^ ^-^^^ hrf-:^^ifLXyr^^-K m^l t&^y^fa-^' 
'f 7 - tig^t * k:^^T^i>o 

@^{c4'oT>.^;&o i nod c-;i7r^;W;|l^i-&^^^r-^';<^ffil&^rSytJ2 
£<;){;^>,^i;>ii*T-^^Mt:-*4o i no d eiciS}t3ii4> ii. m^.ifi^yr 
-^^ ^ / n 7 ^ (0 '7 7. ^' ±of)l£S « ^M'i t*:**^ **i-«o yr^^r-o^ 

■oX r^fiitJ -Cft'it'^i.-c.o 7r 'f''K??M|lr7!)*^-<^7T 'f n.<^f^^'S^:Sx.*fc<^■^" 
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)P 2G04-3892S A 2004,2,5 

'if i n 0 h ^~i>i> 
-a nywlie r e 7 t -f A' -> x 1^ A :?>*i!> f-f 7s^';J^»5-e<^r*'f ;^i^±<^7'^ 
tii^oTSo Write-anywhere -7 t A )\y'y7.-r lAt. t - H^t i 

rfi-tJ^mMi}^'SSm-^<i:^o y r ^ ^~±.X'*}m-~S i ^ K^^^^l^^^N r i te-an 
y w h e r e 7 r ^ JWv7.7^A(7>-r!lti:. •) 7 ;t )V^rm-^^-^^^ )\^m>i-> y )- v 
-:f 77'^'<T>';^i±^'fj>A*'C^*Wi i t e Anywhere File Lay 

out (WAFLi 7 T -f A-V^^f-A-C^feSo WAFL7r )^v':^-7■Ali^ 7T-<'5>- 

O^H^^t T -f 7n h 1- - V «0 -T" D f- ^' ^ t LX u - 

[ 0 C 0 6 1 

^ri^ -t 5i4-^g-^«. 3 y fc" jL - ^±-C^iTPrBli?5: > fc* - oTi^:^ ^ V^M'^ I 
^ 7 T >f 7 - <?)Jig-. C (?) 3 - Ki±* U 7 rfH* '^'f Pi'ti^j* ^ h 7 - ^ T 
7'7 l"T>7s1'i5i^i5A^^flli'S:D a t a ONTAP (K ) ;^ v:^-'^ I— r -f 
v7.7^A*<?>7T'f ;vv'7.rA-t-7:/T-f •?:^'t*^t'^=b'7>X-*)»), Data ONT 
A P7. h r 'f > ^^vT-r A {i-^e-f ^5' D ^-.'l'-!: l.T^.jS^*l.s Writ 

e Anywhere File L a y o u t (WAF L (R) ) 7 r ^ JUvT-t^a t 
^l^l'So X I- V-:/:t'<V-r -f ^'^^v'T.rAfi. UNIX (R) ^-W i n d o s ( 
r{ NT$c^rriffl^J-'^l'--f -f ^i^vxr A±-Cttl'^1--€)T7"'J -> a V 7'n ^^-7 A 
i UT* fei-^ i i 4) T- § * L . *?^*fflS t- Kti- & J: 0 7^ h W - T ^ M - >- e > 

[0 0 0 7] 

<'>i:i?^'t\ ^'V A-Ai 7T1' )V->7.rA{i— U T S *U-) o 'KV -a-^A 
lj^c?)T-'-f X tiafv 1 y.±fiO:>'.'i'- 7'C>R A I D (Redundant A !_ r a y 
of Independent (Inexpensive) Disks) f-li^ ? 

AFL7r-</^$'•:^•rA(7)-rSr•^i^ RA i D 4^Ssf^l^^«fiJ{-Sv>f>*i-Ci'^^o '-<^ 
^^^^;J®•t•<4^ 1 ^^JV-'/^f x^'m^j^roTf'-?'*;^ N v-l" t';'^'t> RAIDf 
7*60 (7) its? $ 7"" f 7, .^rtT'dSIl 'J T -f * ^ •t-:? '>a.i-^'£>g25^ib*o * 
^ai»t^EKl-<><t 0 ^ ^ {iJi-t. R A T D 4 ^ fz\m^<JM^^W!^<Jy%^fi 

il^ it o -C @2fi 3 *i ?t V ^j'^ < i 4) 1 T - ^ r' -f ;^ & CK 1 ^<i^il^ j1' r ■< r -f 7. 

[0 0 0 8] 
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Blake Lewi s1ife££^*@f f 5° [;4;^ 

WA. P . J g System Dc-b 

^NTAINING CONSISTNT STATES OF A ^^^^ 
TEM AMD FOR C RE AT I h G u |li R A;. C t^b i . ^ 

[0 0 11] teBfl*.*.itr ^-cr,;}-:')*^A<?>l3[t«0^t"-'7'->3 V h 5 
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*fr^)^^7 + y^-> 3 -^^ '■''^■''''^*'®^'^'^'^f !^i*i4iI-r^^^3^l^ 

^t^TFlLE SYSTEM I M^^^^^ S,e 
ER BETWEEN ? ^ S 1 M I L .A R F i L B ^ ^ ^ , 



50 
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/ov W 2G04-38925 A 2004.2,5 



? t .f^l^ i ; - J ^ ./v - 9 > BT tg <i t * * >^ a - A «jTi|^ J; i . y M § H 
r G -y J t ^ 4 ^-^ I- & 7- «5> c^x i t ^1$ ? /t: « 

1 0 0 1 7 1 

J ; a ^ ^3 it ? itr^ ^ l-iit^t & a- > «r#)Jffl , V 2_ 7 T 



30 



40 



50 
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(9) 3P 2G04-3S9?8 A 2004,2.5 

[0018] 

2b o ^ - A cf ^ iS'-^ ^-j^ t tbto r -i v Ti'^-^ r ■< x .-^^ ±(7)|fi ?t 4^ 

i'^<?)Tv #j5!)tcSl-?i^-2>o ^M<7)^jo^cru ti^^fpS^i-^ i node 

^.*^7'D-t;s;^-«i/>Ts y-7.{i, iiifi c^it/trQ t r e e r^si-ftfec/:)')?',' a- i.^T•E 
(c#(c|igil-^;&gJM5H?trD'> i^7}>f> i n o d e {fc-fo i6D35^m^-/o -t 
2o^;^7- -;' T'va y h 9 >7!><^M?*L/c i n o d e ^-^Cas 'e<^ 

i!BP. ? H 7^; g > 5r IX '9 iii -^o i nod c- ii m C V^j ^t>^y r ^ )^ lc ji^H^^^JS $ H 
Tv^*,^'^ ( i nod e 0^) 4 5g;#-^5()«^'5:<?> it -Cit »■••€>) v 'k\r^i\.<f:>l nod e<02 
■o<7)/N'- 1) tili"<. -:&<i^/'<- v s > t:'>^:M'?>3b-3/c i n o d e 
^0'•^'-^^s >T-?'**Lj^<iD i n 0 d e tl?i-<iD-f - ? /"o Lgt-f<J5Tv /-t-va^ji' 
^1 ^ nr.- ( 2 OCT? X + a ^ WXr) i n o d e ti> 4 :i - (CA*l *5 It^ i 
nod ^>^y F^/'y f^./v;/ Ky^^ i n o d e Tv-' ';-J <^T:fe 

0 V kti^M^mmii^^^ ^(n'T -a ^-7 ■o if ^ V 9 \:. i. ^ Tfig!) %ivht t*:^ + 

r -f ^I'V'X-f A(r)M$/f<iC>7'v:36JC;?. f- 7-:»*^^LTJ^|#$^l.*^0^i■ 
[0 0 19] 

- 9 <r>r - ^ 7. h 'J - A (SO * V I-9-^$:3rL./.:^lHJ'{i\ 

;^ ^ A>^uMjif'-^»^^t*u-.^-g"(>^>-&o 'Tyx.tf. P/i * 7 r jwj 

^iLi> i n 0 d el^--^ ^7-^±^cjtml., ^-*i.<bl'ir/c=&r*f ^ 'J^jticv^ M 

5e^7 7'1' i n 0 d e-v /fi. V-T.c^) i n o d e (7 7-^'t') * 
%.%<r> i node (7 r-f ;^) J^iv v > ^-'i"^ v -.v 7'l:i&<^ni-;6o i n o d v/Ji <o 
s 4fifel=fii**$T'&o ( i n 0 d ell-^^ ^^#-^) c^.) i: oT, vXrAii, 
7 7 .'I'J^i^ir LTIjSt ^7,-f 'i>izt>(r)-? 7^ t^i^ y K Irft^l"^ Z, t i^WbI^-'Sj & 

1 n 0 d e t-5?-$-|frJt:U^tfi^tr^7r -^JVUSf ijt)^Tl-<) Cii^W elite's: ^^•C-<0 

h';xT--y^, Biria7.t--7-^ V'cv-7~.r'( ^ v'if$Ri-s-fiL. ■/^*?*Lr^7 

7 7'f ;v:^W3$n?t^t^^r -f I- K'J v.-^^;!!-*,) #r/-:fif^g&$:^utv-;^ 

7 7 -f Ji-jo^-v y 7'(cAit»3i5.. -g-tor"'.' l-^ p; -tcill^^iis^ it<>o r-i l i^ h *) 7 5o 
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(10) JP 2004-38928 A 2004.2.5 

Jtt4>^H{±, i^-t ''bW.^.y r ^ )i' (i ftode'^5'-/{::J:oTiRSy^n:&) Kwf^^ 

i^-CJi. ailS«)'(@S!l<7>v-7>Q t r e if^ii. ^ * v - x jK - a ^^-^fig; ? it 
[0 0 2 0] 

? r^ji, V-;^ i nod e^^i'^hM^i nod e ^■f-'^W'^ •;; tf y^'^fr* t i n o d 

LTv>^->o -r«i n 0 d e T"!; J: !o , 7 7 ^ ;u->xf A icM^fei: 
<i0ffl5lM:iWg6(-4^^>o ^'-t:. >-«0i n o d e t v "/{C J: ^T. 2 W±^^%^X + v 7*y 

[0 0 2 1 ] 

WJ:^fi5*;^?^:^-CJl, 7 7 -f Jl- v X';^i^^^iE??cf)7 * --7 7 M'ffl'/^T, V-X</.)^||"^ 

<r>r^ iJf X ^ >; - -i. J&^ji-tt ^ it-?-. » §19 1. Ti: 7 r -Y )W f - 7*0 if fi, ti <^<Z);^- 7 -t 
f !ctto-Ci-j£i>^;2>fa^7r .'i/t'^^iii* I^..S>o i n 0 d e'^-.-'T'ii. v-7xC7) i n 
ode (7 7 -f ''I') l'5S:5fe<^) i n 0 d e (7 7 -f ^'U) i-v y tfy ^^t.&v y -f^^m-fi> 
o i n 0 d e-^-y ril, 4^t-?'<>m'#T«.o ( i n 0 d e#-t. 4fiJt*#) <^:?'7')VU 

T-o-r i«WBl^t::'S:'&o i(0 y ^Vii i: oTv i-N fi:, 7 7 -f ^'i-a^i^* ^ 
<r>mt^^"4-L. ^<r) \ n 0 d c- §^ I: #r ?t: <' -(t fix L fz 7 7 -f '5 ^ T # ^ i t 

o-ty^<^>11g}(^r'-f U^' T- 'JXr-vfiv BirE7^>--V'y ^TV-XT■Y 1^:^ h 'J ft 
^•iU, -i^*^*ir.:7 7 Y.'l'^ f^U#S!)$itr.-7T'< )P^1-^TT>?K7»/''5rt'5:fc^ T 

n«>o T-f i^:}' -n)-i}^^^^Xi.fz\k. y T -i )Vt- 9 <r)^'^'kU^-f^o v-Xt^^ 
fjcf) 7 7 -< JW-/'- if Ujrt-t<,^M{i, i!:j]5E;T^-.ttl^7 7 -f ^'l' ( i n 0 d 6 rv^ J: of 

'?*M*L, >'!>%<r>tji\-^^h^i>y7 ^ r^- <M^^j:mti-^Mzy r -OV^-kb) 4'7k 

jKV a - a o-f^^^fig. ^ iitzm<r>-v um^^ . 1 oco5B5te** V - a ? 7 - 'y' > 

[0 0 2 2] 

S!^<f)^^^^5^^ff^®•■C'^i> ^l?7 7 -f ^uv'Xf- A-c-tLi-ftcoxt- -y 7'-> s h li^j^feT-is 

r^lKti^. ^icOx^T..^- h^ii-.tT.t^'T'v-g ■■M-t^^g^i-:?>o CifiO^ 1 ^^x^t. 
^l=Sr^t^2(7)Ji^X*- h$:Jl,'t:7^t•^7*v'3 h^^^^l"** ?S^.7 r ^ ^^ v'X r 
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(11) JP 2Q04-389JS A 2004.2.5 

[0 0 2 3] 

i n 0 d £-77 T'-S'^i^T^S^icab^^XiJ/-; 7-7 r -f ;pv'7.t i n o d e lev -,v 

V Sv> rv-;^J {cJti-^ i no d e v-?7'<iC»$£E4^$ffrt* f^^J ic^rrvi- f-^Ji 
■gft t r^* i n 0 d e rfi^ v - x± ? ti. Kig^llStc l-oXTC^-t'. 
^^.X. mfzfi\,'- -;^<r> i n o d e l^i-^ Li'^N'fi*^ i node **t&*JT?t4^?£^v 

t -v V e > 3 li.. c *i |c J; o -C *g 'S: 7 r -< T -t ^ 7';i/:^^^figi 3i ti & <> Kr/c 4^ v 
n * o .!s:g i n 0 d e -v v 7';^'^^^ t i . |lr& * v - ;^ -^-fiO^S § It/c - X'*^ L 
[0 0 2 4 ] 

R5j$|l;iSf^i|-e , l^l C V - x to 2 o c^j^IS;/ :5 7 - 7^ :h -y /->■ a v V ii^-K. '/> U^^M^ 

IS) ii^^&^ 'i nod e"7v7'*^5fev':^-f A {cfeii-?-&o -^v>T'5tt^->':^-r a Ji, 2o<i^ 
-^7>y'h.(r) i n 0 d e M<Z)P3^1-$iJ^-t-&o Rt'tiJ 7'n-t;i;a, ¥in(f> i n 0 d e"? 
■/tlslBtt^H^^^ (8?ijx.ii\ i n o d el=-^^i£Tl«lB#|c) o /o -t;^ {±. tc^^v- io 
x:!j>f^<;>§ i n 0 d e i n 0 d e^?-y /(O^^jJ^i T^e* i n 0 d e/^«J 

^'^^^^o '^\^X^~<r)'^^-^Mt^ Ifrjt'fcv-y^^fr,^* i n o d e v-.? -/fi^^i^ifc-v 
•;':/*5li: tT«5^, ico/D-t xfi, l/rl-'v^V-x^fifel^-tt. i node/^SS, 

[0 0 2 5] 

[ll^<^*iSco#.t] 

1 0Si:/=M^7 7i'.'i'-H--'-s3 1 2*-f;>4:i>-ijc7)ffii:ii^?n/c7T.'f ;m--/st^-^ 

M.— v->;^T A^:^3 0 0 4'^"r%7*D y^'gl?-i,^><, |^^±, i<?)V-7,7Tl' » 

, 3 1 4«^>^r«?;^ M.-vr'-r 3 6 0<OTH' (WTT-Mt::!^^ 

i-^) **L.Tv»;6^ t-c. ^3t7 Ti- 7- 3 1 2 4i> r 1" X 3 6 OfiOT w-r *-ibit 
Sg.^*U-> 1 JU±-?:)5g^>K>J a- A 3 1 6i'Wa't<>o V-;^ 77 ^ ^V-4--.'^*^:5e^7t 1" 
Jl/-H->-/^ t'5:t)^7 7 Y n-:^ jWJtV t:^-^ F 7- J?'^^ffl(J:)'l' iJ'- h- 

^<7) 7 1- 'J 7^ S 7 - ^ r-mfix: ? ^6 ^ V I- 7 - ^ 3 18 ^i^\.X^m^'?^i^h^ # 
7r -f 5 - 3 1 0. 3 12 tc^^ it«iiS^;?^y h 7 - T ;?'7'?' ^^ h 7-^' 3 1 
8$:3rL^>:iHl^:*'H- M-;&o C^T4jiieBq±, v -7^ 7 7 'f ^ -SC^%5fe7 r-f 7 - 

^iiiHiw'C^i'>'3l^.;&Jt'9ii. ^v-7^J h^^^^m\t7if.w^(r)W^r- ^ (n>--i^mit(r>'^m ^ 

m.%i(('ho ^ V f- 7 - Wtz \}-7.-7i-iy~Tk 0'?£?fe7 r -T 7 - ii*|^ifflST' 

[0 0 2 6] 50 
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(12) JP 2004-38928 A 2G(M.2.5 

y N -7 - ? *l V - X 7 7 ^ ^ S 7 -f ^ - "fc <> -it <^^cr)^i^, 

&77-f 7- 3 1 oay="3 1 2t::{±> J^^-^ K7n><?):3;'ej.-:J't'&<!t>T. ^%.<r>i' 

o v-7, 7 r V - r ■< V ~ z i 0, 3 i 2<r>^^it^ i/ysr J^'^<7, 3 4 5 "!? 

fflJlg^SSilt/^yD-t y-«-3 2 0 . ^**/' 3 2 5^ ^^^i' ^'7-^'T^^/:^' 3 3 0,^0=X h 
P-vT3^y.? 3 4 0*-^tfo $7l:^-7r-< 7- 3 1 0> 3 1 2Ji. T -i 7-. 

[0 0 2 71 

h /--i^ j;^ h 3 e J. - ^E:^|^ h H -f ;^ :^ r -t ;^ y 9 4* 
[0 0 2 8] 

^J:5^«^iSff^f.-e{4, V7 N7 j:T/n^^5i.3~ Kt'ieiti-'&r^«>> 3 2 5 tea 

& •Cafe* To 30 

[0 0 2 9] 

7 N 7 - T ^7'?' 3 3 0 Ji^ 7 7 -f 7 - 3 1 0 , 3 1 2 -y Vu—f 3 1 8 

V >- ;^ 7 7 7 - 3 1 0 ^' 7 T > h /-If - f.'U<^)tf ^SSejstC'f^-p T , M5fe7 7 
^7-3 1 2 tns^i'-^Zh^''Vl^:&c ItoT. f?!)x.li T C P/ i P-e^7)fi6<^^v I-"?- 
/u h 3 JVSJlU T'-t .'Hb? -y h 3 5 5 t ' ^- 7 f 7 - 3 1 8 4"iht Ti^Sfe 

- ta:;^ 7 ^' T > h ? + - x<7>|g:||^^Ti i: -£■><, 

[0 0 3 0] 40 

-^ ^ T^/^ 3 4 0 ii.. 7 7 -f 7-±*'i::-|ltf SiitTl'^<>7x h l—-yi^^U-T-^ y 

if%/7sT^4 0(i m4) t^miX^ ^y-(7y h-/i'h^t-^iif.:^ni^r^-tyst''i> 
i^{-?g^^:&/wie><i^/\/ii.* (1/0) -r >^7i-:^ia@t*L.-C('»*o 

L.T:^^-H'-/N'^^fc-r^%^-. v-7vtA/'{;^ 3 4 5 5'3'rUT^:v h 7 - .^^ T ^^7" ^ 3 3 
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(13) JP 2004-38928 A 2004.2.5 

[0 0 3 1 ] 

f"74ry hit, y t t i y - 

:^lfm%y 7 i ^ - 3 l O, 31 2cr)^-i^■e'3^^c^^It^ ^iih<DWti^^-t&^'-'Si:h 

AN-efi^ifi^O-^ V hr?-^' (3 18) iii-LX^^-^-^c T-f'it. "7 4 T y \- hm^ 

<7>77'f7-3 10. 3 12 ^ii-l' > - N 7 7 l" Jl-vT.-f (C I F S 

h 3 7 4 'Iffl'/^T^ji Si it*o 
[0 0 3 2] 10 

-^j7]F;fi54^7 T-f '^-^i^lJiiT-a. ^7 r-< V- 3 1 0 , 3 12<i, 7"'- ^ c07 s."- - > 
h h I'^y x^S:^-?-^ ^ T\y 7'4-prHbl-1-'&^ii^t47:/3^AT:5' ■tx.7<-*',> (NVRAM 

('J'ltfewafelt J: -6 -I}- - t: Jt 4- ^ -& i i: i « ^-^ * <, C <?> N V R A M<?> 
•H'-^Xfi. 7T.^7-c»*^f^:il.^y^«{ilt.i:rjs*4>o jfttii. !ffSB#w (PJx.Ji£Sfe 

^t^i)^%J Lfz-^k. ^<i^gt«0^^tg*L.-Cv»^^'7-^ 7^- h{^igf«I{Cv NVRAM 
\t '••< V 7 r ^ V V ^ i M=fT L Ti^/t $ 2. o 
[0 0 3 3] 

~^^>&3^^f^3, Vii. T f :^ 3 6 0 {±1*il&<7) >K 9 ^ - A m K \fV - 7.#«Ji-A3 ^0 

7 7^;i'V':^TA4'^§-i-^>j:.o (::i&oT»'»«>o i4tt><iO/H'J a- a{±, 1 J,Jl±<7>r .f 

7^^5' 3 6 0 l-W-r^-*^ -^l-SSSf^f-^ii:, Iff ^ l-V^RA T D 4 ^SfctCt^oT, tiS'/'v 7s'-/ 
3 6 O^^RA I D^'';V-7'|C^i^$4l., i/^<0:*.c7)-f -f T^iJ'^J^T. h 7 -f T'-fb $ ^ -"t x - ^' 

^ Lj^^fSr^^^ix ■ii!i<7>ffifife (^Jx.«*^f';r -f »5it^it<^;5^ h'?W7'U5$-M?itr^RA I D 5 

-^r-^ 7s^/^^mti->^ t^--l.'5r:*«t^. RA I D^^)W- /l-7. 

!9 3^fiOT-:5'T -f 7^ jS^ i: l^<r)i<^)T -iT i Xi^ti^'ttii. 1 ^K'J j-- A^.t i) 
l^^)RA T D^^'l'-7'»5-g-tlt&» 30 
[0 0 3 4 ] 

B. 7^yv-'J:^^V'-T'iy'y~y7.-ri, 

tlX^W.m^'ti'Vfr i t e-a n ywli e r e7T-< rt'->7.rA!g'||:jST-&o ff-^ 
;^^'±J <^S-77^ - #«^if 1 ^ J: ^ ? n ?t: ? 1" ;^ :^ /n v 

Mni&^^tlli^M<^M^^ 7s h V - > :^ f- yVi/7s7'^Hi}')7 7t)l':^Tm-^:=-'- 

'N'f V h'7-^'77'7'f 7;';^f±75^f3A^5rfigr>N e t A p p Data 0 « 

N T A P ( R ) ;t I— r 'I y VvT^-rhX-h '9 ^ i<0;^'^ V- r ■■( y if-y 7. r A fiW r 
i te A n yy/h e r e 7r'f Ji-b-fT^? h (WA F L (R) ) 7 7 -f ;^ vXt^A^-* 
Sat^o tti;<J?Jiii4 7 7-^Ji^2^;^T^H*^S1-4>ci:»WS6T*«>*-<3v TWAPLJ 

[0 0 3 5] 

^'^v-T -f :^^^v;^-fA7-^T^'f- i'^rav»r*jlt^c:i ^-c-§^t#Af;)li.*o 
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(14) JP 2004-38928 A 2004,2.5 

TA 4 0 0i±> ^ '? h '7 - ^ h"7 m^^if-i—^^-^h (R) K^-f/^) <?):^r'-fT 
T ^ -t 7^ )i £f ^ — il</.)V 7 M7iTli»-.A,-^^$ Jt^><, ^K^t^l'-r -f y?'->Ar 
AiiM«-. ^^-^ :M- • -/u (IP) Jg4 i o . Mt/fw, I p/pT^^*.^- 

^ffij^^^g't-ab-o h h . 3 }■ D-^L . f (TCP) S 4 1 SJ^O'j. 

« -f-l^rvA • f. D,^ (UDP) 14 2 O^-g-tfo 7 T-< A'V'Xt «•/ u h3 

JKlf*. h :3JWc^)f'^:J'T^'HiXl'or||?tct-i->/-45, C I F S -.-/o 1- :3 4 2 5 

V N F S -/c I- 3 ;i/ 4 3 0 . Rt/. ^^ -f • f h • ?■• 7 > :^ 7 7 - • '/d f- :3 ;i/ ( 
HTTP) T'c N 3 ;v 4 3 5 I'-t N-r&o ^ ^d*-, 7^ h v I'- r -f >' ^^v X 
f-A4 0 0!i> RA T DT'n h 3JW^c^)f < xj?;^ h w—yyo h s.-l^'g' x 10 

c s I ) ^(D'T-i 7.^mmyo y ^ }i ^^^T i> r i 7.^? K^-f /?14 4 5 t^tfo 

[0 0 3 6] 

h3M'lii«0ig>)|L.$'-?-4><^7i\ I- V~'y7\:^l--f ■( 4 0 0«0-7r-f > 

-> 7. r A S 4 5 0 -t* -&0 -iSeu 7 r -f v AS 4 5 0 J*, f < 7> ^' ±*t-0iJx. 4 4 
o/s-f h- (KB) iD-f - ^ 7"^ .? rJr^^iVviT'ci •/^'-•<-xc7>7 + V hg5l4:*^^> 
7T^>->:;^-f A^r^^L.> i a o d e i:m^^Xyr ^ )i'i:0M't^o Z.(Oy n-^:^ 
Ti^ii. h 7 y-^i'-y a y^^i^itCX. Wt.-^iifzr- ^y-fy^ T^Ti^J t ^j: h -ib 7 r ■< 

iiStS^tT'S^To 'lf?li»M*>;u^lfeL'5:'^^#-^> 77^- ;i'->;?.r A14 5 Oii. inod 
e^-f-i-ffli/^T inod e "Jr .'H^t^i't^l^Wit. ig^r>x> h y {C7:> -fc:^ LT* 'J 

A-i^ytl yi^^-^rt'^^-ri>^ ^K'^-t*y 7 ^ A'-y J-sm 4 5 OJi> 'e<0'K') a-AT* 
D V i^^^'kr< V- V (RAID) Ji 4 4 0 |C>1 R A I DS 4 4 0 i}^^<r> 

cS-H-f-tf 7.^' K7'^^^*§4 4 5«)ii^'5; Ky-f-'? (^Jx.tf. 7 7 A- ^ Jl^f.^ 

2 5 !c o - K 7 r ^ V - 3 1 0 , 3 12 "CM^i-So ^A^^'^^Tt * i . 77.-^9- 

3 7 2 *^>LT:J'7-fT:/ 1- 3 7 0 t^^i"* 
[0 0 3 7] 

7 T -f 7 - T-gH ? n 7^; V -1" T > i- g^jc ov>T-f - ;^ 1^ - V 7 ^ -t L <t 
it*i.ii''5:^'5:v^±|ax h I'-vit'^l'-f- >i>'v'7v-f Ai-jg* V7 h'JiT r''^;^J 4 
7 Ofi:. -ft^i: LT/^- V ^ 3- T X-%mt i> a t i:, . <fe<>V^»i/^- Y^j.TkV7 

v T -t X^>tt -'■<7. 4 7 0 59^ 7 -f - ji- K • 7'D^''?'77')w • ^ r k r (fp 

GA) ^#gffl]^(S]it*iK@i^ (AS I c) <r>nmt^^^ i^'i>mm.m^hi lx^^'^h 

i>misi}^i>ho i<?>ffi<7)/N-- i T^^lMBilfi, ^'9-^T>'h 3 70 :**|&fT titr 7 7 
fi'%/y.T^'^t^'-<^-^> 1 i k:-Z-^LXy r A y~ Z 1 O, 3 1 tKl^X^^.i^^'i, ^ 
7 r -f )V-if >- 7.<7>M*I^± ? Hi« t -60 

[0 0 3 8] 

h • Af-'I'yf (ft^) • T7'»)'^>-->3 >4 9 O'tab-oo i-JlT -Cif^fflu^^-ri, J: 0 

•y •.■/•> 3 -y ^ c^)^-fkt V - 7. 7 7 ^' ^ 3 1 0/5^ »^$0^ 7 r -f •? - 3 1 2 'n:?. f 7 - 

Xt: lXKy-::^±y 7'-> 3 v H-l!^t«-.1l»#7!>**4bc V-;^T7'»)-J--V3 
> S O^la^T 7" U - V a o-lf gUggii X WT Tiie ^ t J: ^ <i . ^ ;& « ^-t?'^^^ 2> ^ 
7.-t y y-y a y h ' ^ ■f - y V ' T ^ - y 3 y 4 9 0 ii.. T C P/ 1 PS 4 1 5 . 5g 
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(15) JP 2004-389?8 A 2004.2.5 

4 1 Oi^Ut<>m^>} 4 9 2. ISl^Vt^ »^l/7.Tl^7^i--y ^v' a y (4 8 0 

) {i*ii-«> ittif 'J > :^ 4 9 4 {^gt-f J: ^ 4 7 0 ^^WIK-ftftt^o c 

<o 7 -7* 'J y - ■> 3 y Ji . 7 y ^' ;v V ;^ r A 1 i .47 IS 1- T 7 T Y JKo^^R.c&^S^t- ^-fS-f * <^ 
"C, 7r -f .V'^-7,60t- ^liit ji i node 7 7'f .v) ^rfflt-^T v-7x<i^;^ 

[0 0 3 9] 

C. 7>+-;'7'->3 h 

«fij:^<7)WA F L 7r ^ ;i^v-Xr A<,:S;g<?)S n a p s h o t (R) -^Bgicoi^i-Cfi. D a 
vid Hitz^lJUi:*rFile System Design for an N 
FS File Server Appliance] i:ffiLrcTR3002 L'/»l^ 
>) . Cc7)3tg^{iC c: t ic j: ig ^^JS^Ji^X^ j^.^^ [Snaps 

lie tj i3^'^^y h7-^T-:/5^T>'7,tt<0:f#S^-t-ab<)v'i'!:(.:aELT^l.v^o 
S^liv C<?)#l!=6^ie*iT> Persistent Consistency Poin 
t (CP) Image 4•f&'tr^^^)(■:fflv^^i>i^Tv^^^» Persistent Consi 
s t e n c y Point i m a g e ( P C P I ) i (i^ IBIS^g {nL ifr < 7-^^^ 

7 7 .•l'vXTi^*2b^B#.6-.X'.S?S,L/tiiO'C-^.>i9. ^COPCP i ^li'J^el.fS'Cf^j^^i;^! 

;< «- ->'56«f^^ ? ■C<^)T f- -r 7*7 T ^i' -> X -f -4> <?:)-ftfe<7>1t$^ ( y J' f 

-^') Ji^^t ^t.^:^§-4>^^,> rPCPIJ iv^oSftt ^7^t -.^ a KJ tv*-?^ io 
[0 0 4 0] 

<07.-^i''j-.'l'}i:A:^'5:^<t<7>^#$'^»7-'S->o ? f^U. 7 t -f 7 - it-£.7.7- -.^ 7" 

<i07. + -.y g V h R i/n <7>Ik ^ 1'^ O 0^ -C cO^ ^<?> ;^ V 7* V s f- >3c- 1') ff.-Jf t ^ 

'^i)^i>Z', o X 7- -y 7" V- 3 y ^ a . T ^ r -f :^7 r -f -7- a i: ^(if&.*^ $ it, tlT'r-^ 3o 

L <iSl^i-«>J: Ot::, h l. - v -f -f VfT'y^^l. 4 0 0 ^ .*^ti:^t 7'vg r;' 
K 5 7~T7'V> v 3 >• 4 9 0 t tc. 7t ^' ^ ') <7>-''^ y 7 7 

[0 0 4 1] 

Fij75M*Suf^HcJ:;j,{aj^.e*)7r^';Pv-;^TA i n 0 d e^ntS 0 0 4:125 (-^igtto <-<0 
i n 0 d e 7r f ;k?> i n 0 d e . •r'5:t5*>io F^'i'- ^J inode50 5 Ji 

V %^-(f:i-?riA''yA^l^\Lt^-t'h i no d e7T-^;i^5 0 8 ^-.^-^jf ^^iSJf LTi'^;6 
o ie^:)^;g^^^^7 JVv;^rA i n 0 d e^?ter)^^, ^- N i n 0 d e 5 0 5 in 

od e7r-^'^^fc1^r^v^^5 1 0'^<7)'K^'>^t^F.j#Lrv>;&o i n 0 d e 7 7 -'wra 
^■/n -y .5 1 0 {4, 1 )£il±<7> i n 0 d e 7 t Y .'l^fi^ /D 7 5 1 2 l-Tis ^ . i 
n 0 d e 7 r >^ia^•:?'o v •^^ 5 1 2 iJO^^ i n 0 d e 7 7 -f 5 0 8 ^ifg^t* i n 
od e 5 1 5-^<??—«<^)*-r LT i no d e7Tvf 

5 0 8 <1 i n 0 d e 5 1 5 S-fllJ^-T* ') - A 7" tJ {ciSSgi $ i^^ i n 0 d e 5 1 5 
(± 7 7 -f > 7= - ?tfi Tr-f :^:J'J ) •/dv:}^ 5 2 0 A, 5 2 0 2 0 C^O 

> 9 LTi^»-&o Z.<r)m<r)m%. \ node ifta' 7 ^ ^ ji,^.-- ^ ^ 

^' .'I' f ~ 9^ T'n -y ;j? 5 2 0 (A-C) <fy^^\i. 44ft3^'C.'f h (KB) - ?"£'^§^flT 
«> J: ^ (;:^:oTv>;&o Vii'\.Wh. lofiOinode (515) J: o'C^g?^?:^ A 

6 7 r f - r D y :*^#E3 $i iioJ^-g-, 1 Ui±<7>^i^y D ^' 5 2 5 (•(S'^gft^U* 50 
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(16) )P 2004-389J8 A 2004.2.5 

ti>yr^)\^-r-'$'ru^,-^^m-9' m^^^T> <> *4 i n od c- (5 15) ^^mi^rt^ 

■^i^S-lf t-cv^«>#-g-, ^</.y i nod e <3K 7 7 'f ^ -y ^jgTC t {i<fc 
10 0 4 21 

U:^i- J: 0 '5r;^-7- t'v a -y ^ i node 'ti^^'t^o ^.-f-y 7'v a -.v h i n 0 d e 6 0 
5ii. ^S«)t'i7r .v>-;^tA 5 0 0<O>- f- i d 0 d e 5 0 5 <iO?Si?.-Cab^o ftoT 
^J:^<i^)7T -f ''i'->x-fi.-^m6 0 0 ti:^ [3 5 Uia:^tr>:'teot[B|i:. i n 0 d e 7 r -f Jl-M 
gT'n y 5 1 0 . i n 0 d e 7 T f ^'I'jl^T'n 7 5 1 2 > i n 0 d e 5 1 5 , /^O', 
7 7 -f •J' -y 5 2 0 (A - C) 'k'^t^o :3--^i}^y 7 4 ^Ut'- ^ -/u v ^' 

^l^LrsT^-g-v 77 -1" ^v->7.rAJitj:, ■t<?>$(r/.:'5:f'- 7*c ^ t-r'-r "s ^ ^#3; Ji<?)^ 

[0 0 4 3] 

12 7 fi:, 7 7 -f '•I'-r'- /n y if^'^ % iirrf^w^J^&t) i n 0 d e 7 r -f -> 7. r A:^ 
it 7 0 0 ^'^LTi'»:&o i*7)eaj«r»3t|^^ T 'f :^;J^ 7'u 5 2 0 C{<:fe|fi$iH?t:7 7'f 
T- 9ii^^~^^i^t^e, «ai^<7)WAFL7r-<.Vv-;^TA(i, ifiO^M? ^^-Jtft^tr -f ;^ 

D V (515) <<:t'&:W %^fz\ n 0 d e 7 r ;pt- ^ (i, 7*d v ^ 5 0 2 C ?rit1" 
J: •? tiS^J^x. >iit-&o •.!:'/.)^Mi.:J: oT, WAFL{i> 5 1 5 (^i-o^M^ft/cf'- 
tcov>-C|lr/«:*-f -f ;^i'7'o-;>^!' (7 15) *fjfJ^-C*<, I^^Jw. inode77-<A' 
re^yo 5 1 O'SrT'n y if 7 1 0 JcSilfex., ii^/n-y ^ 5 1 2 4- 7*0 v 7 1 2 
{c^^j^A. DT.tf£^M?4tyc i node 7 1 5 titt J: ^ ?to-C. 7 7'f.vr 

^^ ■:fX3~j <J>^^.-hm ':> f'^'\k. 7.7- :y T'v-- 3 N i n 0 d e 6 0 5 fi> 7C<0 i n 0 d e 
7 7 -f" V Af APS^ 7*0 -y ^i- 5 10 's<?>4>''l' llR*^ L > i n 0 d 6 5 1 5 :x 
i^**L.Ti'^<&o r^<r> \ n 0 d e 5 1 5«i. 3C<'57r 'f ^Pt-^^u 5 2 OA, 5 2 

i n 0 d e 7 1 5 *^M<?>7 r i ffT-^Vu 5 2 0 A 5.^= 5 2 0 B'\<7>-^-1' > 

Lj^^^'L Tv^Jiiy^o ^ i n 0 d e 7 1 5 7 r 'f ./7 7 'f JVv;^^^ A<7>ilr/^'5:fll 30 
J^*^i-^M3ii?t7r -f ^i-f-^-rn;' ^ 5 2 0 C ^ <?) -i^ i^Jf L-C v <> ^ 
jt4-77^ Jl'->:^rAJW— hi n 0 d e 7 0 5ti, $frr^'5:^jt7 0 0 S'S'ti: T t^Stit 
H^o iBlib-^^<7>7st -.v 3 -V h ^'^tfixL.Ttrn 7 (^Jxfi"";^c 5 1 0 . 5151 

;1/?/;^tA;1.- f- 7 0 5;7%?t:4^ro v 7 1 0 . 7 1 2 > 7 15 5.0^ 5 2 0 C 'JritL. 
Ti'^Ti, ^<.'^7D •;; ^ 5 1 0, 5 1 5.5.CF5 2 0 CJi. 7^^ v 7'v a y h a^^-^^^f^ jjj 

[0 0 4 4] 

fa^fel'^ISI^LJ: ^ t L.-Cv>^-r >• - v Cab^ T^S-J ^ + v t'v s I- 1 ^^o^T. 
it^jj^?) , sj*;^ t- y -f-y 3 y h .'J:SI»r<0 x + y a -y K $-^<^t, 7. x -+ t'v a 

[0 0 4 5] 

D. >tPii$ ■^^ ^)y^/ 

-310 (Hi 3 ) i-'h''-SM<rM% 7 7 -f 7 - 3 1 2 -^(OT. 7- y 7" v a -y N tt$|i<0 57-') 50 
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(17) 3P 2004-38928 A 2GW,2.5 

t ~h 'J ^ - A ± (7) -7 r V- 7, -f A t S 1 4) i L T^^i" § 
[0 0 4 61 w 

Qt r ee^i:^ ti£^^<OUKIX (R) 7 7 -f ;i'->xf A^w i n 
d 0 w s ( R ) '7r ■i ;v v-7s x a {i^3»j-;g> t -f v s >-+J- 'f X (c Jt ^ soft f ij 

^<?)Q t r e e t^fr-r^^^;^^ib&o Q t r e e^Ogltii. 4?-f h'5:)|2l5£^ 
[0 0 4 7] 

±-eia^l.r^Q t r e ^m^',m^^^^ ii<r>X-^^ . %%'^<fmMM^^') i^^\%<r>-B 
?S , -ti ^ ^ 7 7 ^'l- V 7. r A ^slt c: Jiffl -r i i: t i tA- T 1 1/> 

0 Q t r e e^>J^Jgt«0*JS^;i{wJr^«fiji&^isg ^>ii^;g,i t(7)li^fif>-o{±, i n 0 d e 

7 7 Y )v u ^^ij 1- *ij ffl •xr § « ^> -e i> o 

[0 0 4 8] 

i:: ft -S) V ^ 7. <7> ?t: «6 U 7^^ 4- Ik Ji-T -o U ^5: 2 -.^ V - ;^ 7. + ^ 30 
T'v-g?' hi:ii5rj.&^M*gm-?-4-j!lS{coi,^-r §ibt-IJil^i-*gir<;:> El5 -07 ^ig^i• 
7 t Y -y ^ jt 4- i ^ t #M L T is < o 7 7 ^' )K7>ab v9> f - 7* D 
y^'d. r-i^si^ru-?^ (XJi'K'J a- Arc V i-l v t; > ? 4t.;6 , f^;) ^> t 
•f i-A 7*0 -y ^'{i. iH^IJ tf!) a - A 7" 13 ^y (VBN) I'^l'^T— 

nod e-CgJS^Jt^K, iil-ibfiOsK-^ ^^^-iiVB NT'* '9 . i n 0 d e <r)^yjiy( 'y fr y ^ 
-.1 K{i|A)g^ti VBN4W L. 7 7 ■-(• .'I'vxr A (i r^{i:-7''r 7x ^' lU^T*^^ 
t^J: '9ii3'Jfr r :^^/>K'Ji-A-'D-.v ^:^|t<?»,{iii-cJ!;lcj:o'C^ 7 r -< ;k7)x- ^' 
a'Tii'-t 7x $ii'i<>o CL<r)T'( X* p'n y ^'<?>VBN«i, i n 0 d t<r>^4y^y ^ K 
t^SeS^H^o Xtvs'T'va :? ViU nod e i5<i: O*'^*?) i no d e « 

V B N 7 -f - H/ K1--<T 1} jitco 
[0 0 4 9] 

1 n 0 d c-l^^VBN r-^-f >^'J fi9fk:^lt*Sx.-C;^ir-'J >ir-1-*/^a^. 
^'J a. - A y n V ^^vflj I) ^'C h tl^o 

[0 0 5 0] so 
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1. y-x 

o f!l:^&^^M;Jl^•:l3'^>T^ ziii;>ii. 2C'<7>7>t--;' 7'-> s -y h<?? i n o d e 7 r f ;v\ 

o ^ i node "7r'^;^^^ 7, h P - :t l-- - t -f > r X t 7s -^ /e/ a v h-7 

7 7 -> J. id* ^> V ^ 7x 7 T -f ,'U-'f-/<.5< -^'J <?>^'?-.y 7r<^^y -y^iZV^ lO 

-^^Bl^43i/^-C. 7. X+ V- -/v g V I-ai:/^S-7s-^ -.y a h ji, 7s h b 

-■yi^^U-T-i y^^vT-rA ■Ci?ffl^n^->i: g:i::7 h i'-->'.t^k- r-f yv'y7.TJ>. 
iiD- K$:Jl* (-!tt^±Sl5-C{l'5:<) o g-:^ + v/vg v ^ i nod e7r^'^u8 1 0 
. 8 1 2*is -ji<^x H'-v ra ve's 1 4HaSSi$*i*o C^mfrm^. -^>-7s i n 
ode7r-<;i'8 10 {±>K 'J J. - A rn •? -t-f- 5 v 6 , ^0'7 VB 3 i^-Tt X h b - v r 
D y ^'^x t- -v 7*-> a y h i n 0 d e 7 T A 7*0 -y ^ § 

i^<OPi^ii. Wim^<0 i n 0 d e 8 1 5 tw&^ 5: o a-Aro v.'J'(i(±, ^^f? 
[0 0 5 1] 

VV r i t e - a n y w h e r e 7 r-Y ^I'H' Tii? }. l'--yyu 

iSCtiiS^^^in:!?, W^ijS Si it/ti:)T& it Tile's: '^>o tioX . -j$<^)>i?'} A 7*0 

7*13 -y #-t;*^^&T^-> .1 1 U ^5: -?> c^)"?, ■?-<^#-t{i^i/^ 7"n ^ Ujtj-T jiS'5:^ij7 
T -f A'T'D y :^ 7 -fc V N t tT^^ffit-*-* i i^^-C^i 7s X -y y-> 3 N i n 0 

d e 7r'f ;i/t:S:y>7;-:^v7'S^g f- i no d e •7r-<;p<?>Pa^fiO'^?l<3r)M^<iO:t7-t y }• 
t^^S^nr^^KVa- A/D-;' ^'§'^:;5i1?;&T-oii:Ji. gg^it* i nod ec^)-?*><7> 
lU±s SiJ^^; -eaO i o. 0 d e:^mLX^^'4>y 7 -S ^^ilMi}^^^f.:Z k^Mi'f^LX^^'^ 
» L jjn. '5; »^ >^ s ^:->7srA{Ji n 0 d e ^sK-f >'^<o^||<o-i' >v^-?'(.:^!j«r)^ >> 3g 
^-■?*^i/^^>c:t <j-C§s >-nJi@^«tS7 7 'f.v->:^TA;i»^Jfe3li.2>^^-|iS:i l 

[0 0 5 2] 

7s4vtS2 0tis ^5lS'-H---?-Ls t^') ^-AzTti yi^^^^<r>^(rmm^^it^lX 
s ^MSiif^''<-7s/^^ i n 0 d e 77 ^ jp;^-^--;' 7'-> 3 y h T'D y i!' *S#»t<>o [3 
8 i^^^JT-iis 'N'-:^ X V s •? }• I n 0 d e 7 r 8 1 0 «07*d v 4 ii, 7 r •< 
JV7. ^ ^ ^nil^-e. SS-T. •t 7 3 7 h i n 0 d e 7 r -f .'l- a 12 c^) ya yfz ti^ts 
L.Tv>;i,o cmi. 1 Ji\±<?)*^it& i n 0 d eoO^¥.tS"sL.-C*'^^>o $<bt-s 
7s -y 7'v 3 -y h i n 0 d e 7 7 .'Uc^jT'd -j^ Hi^ ^^^T^t -y 7'-> 3 v h i n 0 d e 
7T 'f;K!5-7'nv:^8<if)J:-?{;:.i.x.*o M 7 r -< H'tcieit* 7'd y 5 6 j±s ^:M? « 
nTV''5:'v^ot?> i nod e •^c^)-te<?>tS$|i^gU$i§-r<, i Or < s igjlf^T.^^^ 
^iX.ho t^oT. IB07 f >■ T'v g I- (■Cj^t^TIWl U'^?lT7s ^ -v > ^^il./^ T'CJ -y 'd'My^ 

[0 0 5 3] 

^%i)^^^fzi>(OkLXm'^^^lfzru-:> (^nJAlirn v7 7Si^'8) iis i nod 
eiS»ff7'o-ir7^S .3 O§'-g'tfV-7^/D-b7s0H»i<?>g«55't-lKjiSi*i.-oo i node^> 
*^f*s l5ig|3ii;f7*D y 7604^:^^^) (Q t r e e 1 D llE-^^i/^-O -= 7- ?*irv>2>^ 
«??*in:Q t r e e<7>-gE-e^.-&#^fi^) i n 0 d e*ii^'r«» i<0^e(:)ii-g-, Q t r e 
elD Q 2:^«jiS^s?*lTv»2><i^T\ i n 0 d e 7 r ^ ^i' ;^ ^ t- ^ c:fiOfll'$';&t;& i 
n 0 d rSlt^di^nj ^ $i5(^^!!jS?it*o MW.^-A.rzQt r e e ^o-g&'t-tiJ&^^'ja so 
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<r> \ node m^ifOi tree! D:*«Q l .?iy^Q i node) it. ^R^S^n-tx 
8 3 0<wJCoT^|^2?t{iitiS?n-g>o ffil&c^Q t r e e I D^'jiS^U^ ^*??tl./cQ t 

r e eMa<09 1 <?^WT-& i n 0 d e<0^'^i'- T'^s i^R^IJT'n-t j: oTtife^ 



;Xv>r. S!H3i^.?t/D v^'5i^jbiS<fflK^ rfl5^>)iB3*i?tJ i nod eii^ i n 

0 d e 8 4 Z(/)%1t^^ '/'T. h '5: *> 4 ^3. - S 4 0 UA*i»ii'U->o itu^to i n o d e Ji 
V l2^<iOJ: ^ l'i;i^ii^C>#^'C|2?;H..5>o ^ j-- 8 4 0I*!<5^# i n o d ei±. i n o d e 
^'^y trzit^-ii-'i 5 0. 8 5 21&(/S 5 Ak^^-^ii, ^Kh<f) i n 0 d e 7-:^ 



i n 0 d e0?-fttjrD-t;;^ 8 3 0{i> ( 1 ) itt^ i n o d e i n o d e#-^ 

) ^ 'N^- X ;^ V -/S^ g y f- <iC>/-{ - V g > /^'ii^ 3 Q t r e e tw*) '9 ^ 'C S ? 
It^ ^ 7. 8 6 0 ) o^)J?r\ ( 2 ) itjflfe i n 0 d e <^®^7>t T^v a h <r>^^~ v a 

> $ H Q tree icfij ^TSi^'geS? (>Kv jJ^X 8 6 2) <sc»i>*r«1v»#fe 

X / s; - ^/ s > ;^ CK^ a > ii^^^^^X. * il*? Q t r e e (iSl '9 
.?lCJ^Sa?n4'i'^m-^. M i n 0 d e ^WMl- i^^-y^T^^ 6 4) . i n o d e^^*-v a 



^<-Xi n o d e^i^iR3 4^K:Q t r e e {wfjtj ^-C,^c>@ea$ nijv>;?^ i nod 
e{i)iil??it^Q t r e e tf!l*?^T.^a'ieS?*L*^i&, CJtfil^j^ 7t Jl-^^i^JISB ? 
H.-^iCLi ^rAPil^ L-Ci'^^c?)T. i n 0 d e .^:M^'7- - (#v:i^;^8 

66)0 X i nod eti:3i«?^it>iiQ tree lcf!|J} ^T,^O^iei^ iL&»5 

, nod e{iM«?^iir^Q t r e e i^fH '9 dST. 510^16 fiS it's: i-^li-g-. itUi'^- 

ji-i^it-& * X 8 6 8) ^ 



«fS{:i. -^-x i nod e.iiCP*';^' i n 0 d e>!»*M3i: tilJtSiitr^Q tree ttll'? S 3o 
-CSE^@ei$it.*J|-6''v T'n^iXii. '^t-X i nodet^S-i n o d e :^'*[^ tr.-7 7 

V 3 y jS: t~) ti: $ Bfe't^a'i) « <> i it . S^.^l^ / n * 7U>: J: o T;^^ ? *J.T (/> 
&|l'*'5:/<>-->'3 i nod Qm^\:.Ut i>^^ji&±A^^X"^^iii>^ z<r>mfs. 
H 3 7 r -f ^I'^'^jH® ? ;:iT ?gi^ t J: ^ , i n 0 d c- it. iEfii 4^ ^ n ^ 

^ o < [SI D 7 7 -f > T- ii ^if (/ > 1^ •6'- > n j i . - ;^ -7 T -fg ^ :s i^S t> 7 7 -f ;k?) 



SSBfi. ^<.- 7s A -f •:> V =y 3 •:> h8 1 0 f^isit^^M? tl.f 7*d -.v (-7*0 1 

0) . Sy^v ^ja':^t-'7'->'g ^8 1 2ti43}t&^M3ii/c /D w (rcv^jj^ 1 2) 
<?>fsj«:§>5rU-^^lt-&jt^(^)i¥ija$:^UT'/»*o i node 2 8 0 0ti:> '^-xi nod 
Q'7 7 \ n 0 d e 7 r -f /P{-'biiJ'9 ^-C^>4t.Tv>C^i,^<> ^(^^^r-f 

JV:*«7t'1' )V->7.-f AUjiJq?itr^Ci i:tti^LTi/^^>o ^/ir, i n 0 d e ff-^l? d -b 
CfiO i n 0 d Qii'^UiiQ tree Q2 (C<iO^J^:)^^-) (igSS? *l'Cv>* C i: 
iie UT'/>&<, C<?> i n 0 d e »1, 7 7^ JW^^Ti^fr tv^ ^iiC^.) ^-^j* 4: o ffiiWi: i: i U 
. P,%^ilfz \ n o d e ^ i-tcJI^-igins ^Jig?^i;6o 

[0 0 5 9] 50 



[0 0 5 4 ] 



[0 0 5 5] 



[0 0 5 6] 



[0 0 5 7] 



[0 0 5 8] 
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i n 0 d e 2 8 0 1 {i, nij<D i n o d e 77 •< ^UfSt? ^T^itTv-^i^ i<7> i nod 
efi> jg^'S^Q t r e e Q2{-SS3*l. 2 ''^-''J BV<r)Z,&) \ tio di eii^^Z^^^ 

<iOr> i node 35Rjfe^ii z,^^r^ ? n/c i n o d e - JCiiil L , ^-t-i)^ 
'/>T*i<7>T*- ^' tc^M»%or^o-l-^iJSeT«.o i n o d e 2 8 0 2 Ji. x i node 
7 7 -f .i^f-fij^ ^-C^>nTv>;6:(j^ ^S-i n 0 d e 7r-f ;i'tcj±t!)t)^Tf>:Jl-Cv>'?i/^o 
i n 0 d e V 3 jiS'5:Q t r e e Q2U^o/.:o iitfi:, i(0 

i n 0 d ei)mi^il/^Zh^aM^LX^''-i>o i no d eli^^,^i±. |5l#{;: .roojf "7 

M^VL. I node2803 {i:. i n o d e 77 -f 

T»->*iT'/»t:. ^'^i n 0 d 677^ ^I'U^^ilt^^T^iJ.T'/^-?)^ inodeiS^feSS 
3 0 ii. 2 OCT) g fal X' ( # l t # 2 6^Fa1 T) 9 H-fz ii^h'^iyi, c 

i:?}^*^. z.\x^mUTi',:r.tr)^x~%--ho i n o d e:*^^"f 7 7 -f ^'Ufi: i n 0 d e 2 8 
0 0 tl^i^JCQ t r e elCi|^in?nrv>;6fiOT\ ifiO i n 0 d e(±. 7 r L 
v> cot:-^ «. t i/M ftSW i: i: i U . gEgSHK i nod e ^ ^-l-ji^^ii. feS^ii* 



<i5*l^v 7-*-<?)^tgli. +j.-rt<7) i n o d e 7>-7'|cjy-L-CM^f'ClT<t*54t;6o 
o ;^ 4 ^ y 8 2 0 8 3 0 t\ •fi!j<03^n -t x i , «S#^<?^«04' 'C-'f r 



2o<?>;^-7--;' 7'v 3 y KUi5»t-€> i n 0 d e <^ 2 oeo^t- v g >• 4'^^tT^ -g^Jl 
j?<?) i fi o d e iJJ'K-^ > ^ tifc|gi--2> J: -9 (CiSj oTi/^^<, ■?'l1.<^<iD5K^ :/:J'<^ 2 cx??/-?- 

<07.-7- 7'v 3 y h Wt-i^ t ^ ir^M ^ itT'/i!5:i.'^g:*:'5: 7 7 JKO^ Bn ■^<^7 U - 1*) 
7*n ^' (7)V B N(-:^M55*^-p r^3i^go-<7>^|g'g-x + -.y-r-fe w i::*^-C|i & t 0 i i 



e^Jt LT. 7-* - 8 5 0 9 U*To 7-^-8 50 Ji. %'^<r)h'otz \ n 0 

de*j*S:®t^i. §i node ('^- :^5.y'.^T><iO^-* ) 9 1 0SO-'9 1 2 4:7s^-¥ 
^'LT. :g-*«^)yD-^t>'K-C7 7-l'''i'^7-t-;' N55^-|S:1-<> ji^S»--t^JSeT'&o Cl«e!l<0 

l'ill»t, ^Iliit-iSW^/D-^ ^ 8/9 (9 2 0) .^iCif'S/l 0 (9 2 2.) U|IJl1-^-.o 



o 



[0 0 6 01 



[0 0 6 1] 
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JWVT^h (ACL) , i n od e 771' J^g#:^C!tiifflt-^•>ii::^«•■C•^'&i:v^o i 

[0 0 6 4] 
[0 0 6 5] 

^S^>'■^?'«:^7^t£^7'v-a }-<±. a-A<?)Q t r e e^<?>1i]lfif>^.K3il.7tT 

fii^Be:(^**Jj;i-<.^a$i*8.^ i n 0 d et. i n 0 d ei3^tl^S 3 0tiiS5^T^-.o •Tit'^ 
<f)^:W.^Hf^ i node fi^ a.- 8 4 0{-@BS?4^.. 'Xv»-<r> i o o d e 7 - *- 8 5 0 ^'^ 
. 852X0^854 <n>§:&i)K ^^i/.) y >) ~ o^H'P^<>o i n 0 i e r? - - ii^ ^ 

. ^MtSIKS-^tf >• -b- V 1 0 0 2 > 1 0 0 4 1 0 0 5 5* V -7s/-nM 7*7 'f >• 1 0 

1 0 Kji#T*c -y'y^ yti77 ^ n^-yT^f-A-r^^t 1 oci:)^- x n u ~ a 

/• V - y ^ L T ^ • 9 - ^ ^ # i- ^ «^ ^ |£ ^ ^ #1 ^ 77 IS «^ - -Bni -r r 
^.o i^-C-^i. ^^^StCfg^T^-. r^-v' K7-i^J {4. V - X 1 5g^5;)ili| L*. 7 T -f 

(Mx.ti'Qt r ee) ^Mr*^ ^'<Otoii4'.§'i,*c-?-*<.'^o'-)5:4b i6^)i^tf J: 9 ^-Ja 3o 
<m^.l-<3:ifiliti:h1r^'^m. (FSYSTEM AND METHOD FOR R 
EMOTE ASYNCHROMOUS MIRRORING USING SNAPS 

H 0 T s J t mt'i> . ±Ti5j y) ii-fz^m!>^!^iiimxtim 3 ax ^^i>-%^m i<Dm'h^'c 
- 3 1 8 ^-j'r L-cmiK<7)T'- ^ ;^ I- - A ^siBi-:& :^^fe:!i^?7i!ls.iy='JSff t c 

ic^)-C§^■.#«lJ'5:7.t-•7^y h 1 0 2 O^M'^SS-r^o A- 1 0 1 6J4x -?-<^M 

-•7<yH4, TCP/IPfi. ^m^ff.i^^^T'n h:3 )Vi/)<ipizf} y-tn^it^ ii&<D-fyi^m 

y iifz^mr- 7. y v)-a<7>tc p/i p^^*-^ •y h$-<^^T^->o 

[0 0 6 6] 

7*-- 7 :y h 1 0 2 0{::ov»-C. JiUT T? f>{-llil^i-«>o ^LT. C<?)7 + -"7<>- b<i^^ 
Sfi:> h :3 JWjRfe f<?!)x.ff> UNIX (R) </)^'^- ^ v >■ a > . NTcOT^'-t 

xs;^ hD-rt'ij;^ h (ACL) . ?XS^<i^7 T -f NT/sh'^-A, 7 r -< ;^ 1" 7* 

7 -f ^l'«'7 7 ^ 7 -t h *U?§eo^^.t r*- )VJ ^^t&a^S^') 



[0 0 6 3] 
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u 1" -6 l£oT, i<?)7;t--v;' h ti:^ 7. N 'J - Acom&u<?4>^f$S4• 
'^!•g t L^J'-^g S^^a*)* ifiO{ci-^'.g>S-^^ab*o .-fiOJ: ^ *:&^-C> ■?■<^0V 
ta^cl^^&o i^'^Cv V - 7s p - x ■< > .»'v7>ta j/cii^S^^^l'-r 'f 

ji, 77'f )Wv'7.7^/s^#:eOK?liN M «?> »'«<0 7 T JV ^ >t: « f •< U ^ rtg5«0^1t 
[ 0 0 6 7 J 

^M^nr^tfllgfi:, f 7- ^' I'iMTiiii^ti. T'^ 1 0 3 0 -C-^ 

te 3 o -I -/y -f t . ^ V T- 9 - ^ T C P / I P /^•i^ V I- 5r T C P / I P 
(C*y-tJHb$*ircXt-y 3 7 N^^r'-:^7> K 'J - i■^ 7 .* - v -y N 1 0 2 ^M^^h- 
^-^tziixr)^ vf^-*-1032 ^r-^ifo 7= - «9 ?tJ/="^ ?'"i^«tg 1 0 3 4 <i 

^Xhiz-y ■^-•^•y h 1 0 2 O^EMiU-CS^t^o 7 7 ^t'S^ii^fll 0 3 6 (iv 
<??7 + -^7 -J Ni^^^j^Jiai tr^7 T -f .'I'f- :?'^'M^7 r -C .'i'vx-f ^[^^(Dii^^^iLEt- 
[0 0 6 8] 

^-^S^fe^ t V 7''> s ■■' !■ ?. 7 - -/n -t;^ 1 0 4 0 ic^St.5>o ■7*i> a v }• 5 

m^^^^^X. yr^ )V^m^tfz{mm^'i>^<r>X':k>^o U7ti3'h^y--^^<f>\. nod 
eco-7-;; r^^^jtSlt. SSrSit^o v:<7)^?ir> v-;^ 7 r-T )Wv.x-/-i.<7> i node 

■t>^<7)7r-<^u;^-f-v 1 0 4 4ii> T-'-f i^.'i' I- 'J;^-f- vt'ftg^L..<:7r ^.v^:, Nii «> 

[0 0 6 9] 

To f!l*<?>^aiJj^(^lr&\ i<7>7.t--V-.;; h tA^ KB(^-fO y if KM^^ilh^ I 

ii^Uiii'^h. V ^(f^^ i X.^ i/Bfiit; fi . * SslJl Jt 0 T-ti-^' ^ * ^ ^) «^ T J: v ><> # 
^c^) r-^ ^J- -f 7"] (CJ: -oTi^SU^iU-) 4 KB'^-./^'* (0 1 l<?>?ff-l 1 0 0) 5!>^#-£ 
■r^o {J{?2 ?! 77/'<-r h (2MB) 'Si^^M'T- ^'{COV^T. ^'j^^ 
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[0 0 7 0] 

if{.^^-^l 1 0 2{;:j±x ^^'/ir^'^^i i i o (omm^-^ f. ii ^ o '\ v ^' >f -/^{t ( 

T-fJK^')xN, ^Kii^ NT s t r e amd i r <0M'^5r*1-ii::**"C-§*o fti5<^ 
/■«-'>'g>09Wi nd ows CR) NT(±v ^IfefiONT h 9 -AJ *J|#g^7T'r 
^ - UMjt# it :i t t 7. h - A tcrar-o ift?§!4 , K a y u r i Pat 
e 1 Itllti J: * r S Y S T E M AND METHOD FOR R E P R E S E N T I N 
G NAMED DATA STREAMS WITHIN AN ON-DISK S 
TRUCTURE OF A FILE S Y S TEMJ i:ffiLjt:*i|i^^til«ii^O 9/ 
8 9 1 1 9 5-ttCK^:^^^i9. ^</>^miiC Z t:^BS,t4> Z. h i: ^ & < ^^itmK'^^ it: 

^v^'-tA 1 1 1 2 4i^S4^.&o v-:;^&a'5a^3s?Iig.60imf 

r-^ * J? > h J 1 1 1 4^, ^^^<7.>r-y^ii'^ifhit^o ^ ¥ ^~f<r>^) 

[0 0 7 1] 

'^v^'l 1 0 0 1 1 0 4 <7)T- :J'<7)gjia\ T'tcjS.C-C)** :2>o 

iS-^-S^^^^M^-'J 7. H-<>^#:'^y 3^) , tTt\,t. ^(r>%^y tr^-^(J:>^% (1124. 

^<f>^^Wm.V~.m.^tii^-\t^v 9'm^X%-^k>„ ^S^-y^ti:, f-^^'^-g- (r^*^ltr^ 
7 7 Y JW^) ^ fz\i%m<fMm. ( 7 T jvf - ^-^1 t#Bg-r^> J: 0 tc^^ ? it&p 
[0 0 7 2] 

HI 2 {4. 0!l:^<?:)^i?f - X )- ') - 7 * - -7 h 1 0 2 01- SI t^lf^f^i-:^ L n: 
.aiSS(^)^f¥:r'- :^ X }■ - ^* 1 2 0 2 X'%^fi>^ T.<J:>^v N ') - 30 

A ^iii-i*ifiv^i-2, V - >^ jc o T±fi* ? n 7t^fji^iP55- 110 4 - ^ ^-^^m 3 n 

[0 0 7 3] 

7 ;f --v h 1 0 2 0 . :^<^)-ii<?>^-y i/{4, ^^ta T-'^- N 1 J 1*'^^ (12 0 

it»i{i:#5E<0«g||-C|lJ«1-«>'i:«W«^4-<.'^o tit. -fBr6»--«#?ef < ki^' ^ j9--P>y.)-7'- 
o ibi'-itr^ic^)**. '/»t"*J.iffC'5:4 KB^^D-y^'UD- K?it^>o 

nod t'B.t^r-i Vy V U Sl'l£ji-r<>o NT;^ h Ar'-,' h V 
[0 0 7 4 ] 

f- 1 7 ^-v;* hm^l 2 0 4 i4. MitAC L*#t*^^>i4)*7 7'f ;n;ov»-CA 
C Lffi$|liJliR't-&o AC L<^Wia7T'< JVf'-^'i iiHiiK AC Ll-^-||-?-'?->ii:t<}: ») 

A c L 54 . rii't<^ J 7 7 -f )w- 7 * - V }- f ^-i ? it<, ^ 7 7 -f ,'uti'$s { ±ie<7> ^ 

iJ t M * E: gy t * C i ^« C » :& J: 0 ^ 4- o 

[0 0 7 5] 50 



http://ww4.ipdl.ncipi.go.jp/tjcontenttms.ipdl?N0000=21&N0400=image/gif&N0401=/NS... 6/3/2005 



Page 1 of 1 



(?4) JP 2004-38928 A 20(M.2.5 

h 1 7 HtUg 1 2 0 4 ti:> N T a h V - A f'-.' i'^*- ^ (s t r e amd i 

!•) ll5«ffil|i(>#}#i-4o UJl±^#i|;^ (tL.2bii.t«) l±x NT;^ h y-A^^ij- 

) cr)^gafflg&55> 110 4 t-gri6<3it<>o 

[0 0 7 6] 

h 1 7 .* --7 HiUS 1 2 0 4 }i> Um.r- ^7.V V' - i•^^Ci3^t<>^ -> >?KV 7 ^ 'J 

'3'S>-o^MU-'.^t.'-'T, #^§04 7 7 Jl'S-^tCo •€-tL%<^7r-< ^^7 7 -f ^l' v'Xf- 

AK 7t 'f JWS'T&^ftT&fluJ-'§-<^|l^7 7 }V->;^f-A§'^'^|5iT'&r.:*(?5'f :X7 7;^ ^ 10 

7 7 -f jva , A C L uM/c 't<o <:-^ 15 > 7 7 -f Jv<7>ff;Jl-x?ieiM ^iii>^ 

[0 0 7 7] 

h Hf$|ll 2 0 4l-isfttJti*i. i60 7.+ -*T y hii, Tf-^' A ^ V>-A^ 
/■?- T- 1 <iO$?-JiJ -.f 1 2 0 6 ^-itl^Si 1-;&o ^^fJl^ili:y> 110 4 fir- 

imWi-'^h <!: v> 0 c i *?£4t.<;^Jf* ^>60r-2fe*o 
[0 0 7 8] 

/■i^ ^ 1 t#$|c^)f^. i<0 7 --v y ^ fi:, 77 ^I'.^ICFT. N V - 1 2 0 8 ^-s-x. 

*o 7 7 -< ^I'rt^J^al^.ji. I* 4> 2MB WT<7)^H:?tl. ICO i/i-C. ft^t^^^^v^^l 2 1 0 
it, -C-c^JliU 7 7 JPf - 1 2 1 2 g #50^* < o vt it <5(7> 7 7 4t^<^ 

(zcom'^m't) ^*->^T^^J i 132 tj&mi"4>. m^imu'ryi 1 0 4 (•;|5Ciii-:6 

[0 0 7 9] 

-m:.. yji (121 2) {i, 4 KB<^>!6-e#|i5ist #:>c t-'l>5 1 2i@(f)?l (2 so 
MB) ri:{;^2|s:-^-;:» isi-lft;::^ h'J-A (c:ii^>l 2 1 2) <iv 4KBJA<?> 

Ji^ 7 7 ^ JWeo J: 0 U ii-i ^ it , 7 w -e i 2 M B jS: -p T v ^ ^ 
[0 0 8 0] 

^f^t::. H^f^-^'A - -ts 7 * - -7 )• 1 0 2 0<7>$l3Stcji, r-7'-?'X h>;-A<?) 

tt, ^mmu%■\ io4 (si d (■c^Ri4)T-^'^jt7t:'>v>o 

[0 0 8 1] 

3. 

mBl.^<OQt reei&i:') fix ^ r' ^ 7- 4':i*r L'C v-:^ "7 r <b 7 * --7 « 

tree (^.-^cfi. flfi«0^^4'^|^e<)«3i) -ei^-tr- ^T«i^>;&o H! 1 3 Ji 

X ?E^fe7;:^;y T-v-g h5 ^-T'o-t:^ l 0 4 0 <7)|flfflt^>1-4i<^-c^^o ±Tfgjmt^gi 
^L;t:J:oU, i<7>7'D-t;^Ji, 2oco±g§555>, ■t'5r*>tf''< UrJ- ^ 'j xf---:^ 1 0 4 
2 tT-:J'X{i77'f .V7nT-v 1 0 4 4 75^j:>^fiit;$in*o 
10 0 8 2] 

•f- < l-^^ h';:^-f-i>'l 0 4 2{±. V-;^?5^^r-:J';^ ^ 'J - a ^•J||>i1-«,6^{i, ^^D(C 
-C/-N'- h 1 7=^-v;' (^^^r^A') <or- ^ ^^^^^ kz'^li^ii^^ finj^a^j^ 
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(25) 3P 2004-38925 A 2004.2.5 

[0083] 

<^rS!!;S (13 10.) t^tfo ifi* ?*J.^^7 r .'I' -r- '/^ T Ji s i n 0 d e^'? rf*i«a.>' 
h 'J ^-^ ^ 4t..*c5S^:^ + V •/±fi^v V e > r 3 i n o d e i: v - x ;^ t 
'^ ■/±(0i n 0 d e itO^jiJ&^^^^^U-.^ 
[0 0 8 4 ] 

h >) 7. f ~ -y ii: , y')-^ >)-^>v^m. (13 12) ^^i^Moo ^<r> 

X-f y -fii . ? flfz7.-t y a -y h f l' h 'M 3 3 0 V - X X-?- ^y T'v lo 

J^>' ^ •) i , ^jS-.'*- V 3 ><^f -f I':? h i)''b<f)f^ V *) J^V V k <r)M1ii)^^^ 
7. N V'-i.tM^-f ^ ^ ') 7.*-*7-y hU^J^l., ^ii' h ')755 i n 0 d e#^. M 

» ^ )\^i:f^^'r ^ i n 0 d e #-^S0^±6&##{i. 7 t A- -> x -f A k*] §|S •Cf * -r 1-^5' h 
9 7?^ '7 r > T :^ -t t ^ Tl: i6 <^ ffl V » ib ft <, v - ;^ ii c: ^t) ^' -/.'i^tllR* sir Ifi 7 ^j- - v 20 

[0 0 8 5] 

f>i^, S?t<±Sv>:&f!r<?)) t L.-C5Sk3S?n?;:t:fe. iijilll (f^^-t -SfT^ -f 9 ^ 
2{i> ■r > 5K -7 ' j *. r-^fit)J -f'-f k:^ f- .:i-~^t}^^<OmWtK'r 

[0 0 8 6] 

h VT'<Ttcoi/^T<oii!i@^^^t IX, Q t r e ec^)''i'- ^o--<?7'-i' k^ h ';;^f'- 

*^^i-2>o ti>'L^J:i)''(:>> mm<^^^T-t ( 1 0 4 2) it. jfs^l^ia* *> 

t^;^S&5(-:Eit^n-& J:^ ic, 7 '.'-^.^T'D-bT; f l 3 l 4) <D^^i^^Mk ii^^^^ , 

[0 0 8 7] 

X!}?^*:igi4>^/c36. v-7.t!ia\ /^7^^T•^±4^<> i n o d e#-^5.C^T -f h 'J 
•y ^'liiSi?l.T^^-g>o ii#x 5E5£±cC)^|?r'.^ Vi^ Y *)v^)^ (i<^^«0#-fr. Q t r e 
e) (7)7r^;^{i^ v-7s±f«-l5.t^7 r ^Pi^^i-'Cti-ls^ffl^n-Cv'^ i node§-f 
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(25) JP 2004-38928 A 2004,2.5 

y:fi>^i^^^iii>o IS i 4 t:^i¥:l-:^-ri<^v-y y i 4 0 0 ui:oT^ y-Aii, v-x 

^y^y mSo-<o ^Jxfi', n nodes? 7U?J-7-b7 Y 2 OKBJ t-^-f-o^fi 
$4i..'tv-7;7'o ^\t. i n 0 d c- 9 9 1 2 IS©. ? Ii-i o ^Xv^ TCoyo v ^^{i 

[0 0 8 8] 

1^ U < Ji . i n 0 d e V.V 1 4 0 0 >- M' {i . V - 7. x f /v- a 7 h ±cr)§ i 
node {Cov>T h U tWi^^o "7 /co^ i n o d e x> h Ml 4 0 2 {i!*> v - 
X i nod ( 1 4 0 4) a^^^Htft $itTv^T. vr<^)y-x i n o d e^-ttii-t 
TTi^-tXTiii j5«T'#*o iitf3eov-7.i n o d 6 ti, y \^'y n 
ode <iOlS§ t iiM53^ltc , ii^&fi*-o^|il.tf tut * !««-C-7 '/(C 'J 7^ h ? :^i-S>o >- fiO 
■V 7 .-/{i . § 7 - 7v i n 0 d e ( 1 4 0 4 ) (/.)T(-:^ -7 y t: y ^ n t^: i n o d e 
v-7.±fiO>I^£<^7 r >i't-iti'4>c: t *^tjEl-;6 7t3e'«^v-j^&fix;#-^ ( 1 4 0 6) 
. m^fci n 0 d e§-^ (1 4 0 8) , .^0^, 3B^±fi6§^ (14 10) ^-^tfo ±se<^<fc 
■5^ t'C > i n 0 d e k ii> •^fc^^-C*^ Ji>-t '4>7t -{ -> 7, -f A 60P^ii7 r > 

U it T -b 7. T <^ U 1 JSr 7" .'U- fife T « o 
[0 0 8 9] 

^^■^t^^^t^ti>:ih^zXiU Mii. V- "^±-^7T -f J^c^)^M^?Si;i)^<feo/c7J^S»-• 
(:&C^^ ^«0V-7{c5§1-^^tiJ!? ^T^tiT^c i n o d e ) ^*i)£-t*c:i:^^T'§*o i 
nod e(i^^lE:*^*o7i.ri:l-v-7v!)^?a^(^a^BT*^l&> V - ".Js: T'JU-m^feUis 
ftt-feo >-fi0^7';u{i. 7-7v7TA±<0i n 0 d e t-^twigX!lt*o SoA<frL 

^ A'^i'^^Ti> i'^c/) i n 0 d e v-^ 7' 1 4 0 Ocom^z^^^y Y ') Kf^-^'^^mT 
@E#<^7T 'f JWJ?>rV I'i? )■ ^•ffi*l.'5?♦^*U^'5:f3J0:v^i^:4•y-X»55B^fc^:*•r 
^t^/^. ^fiDTT'f .vS-fgi i n 0 d e^v7'^i> h'J ^r.'^ '^Tt^^ v'i 
tUT^l.i.>c^)fi, 7T.-f .'Pt^M-r^m-^. v-7.{i. ^m$'iti->^y i')VJfkO'r'-^t- 
'^^f'hf.iif-^l^^t^'^^ i n 0 d e-T-v/T}^ ?;>•?• «0V- 7s i no 
d ecfja.:/ h V Kfio V-7 4)i&t#7&i-ifct>t:li&, 'g-<?>7 r-f )mM^fe±(c 30 
a^ii*?EL.rv»«,fiOT-^l[t^fcttf>tf*f>*»'W;v>-5 ^^feii^ i node 
^7 7/U|£^^*ir^^7'.'i'$'Si.>TM^i nod el'D- Ki-^-.^ «f^ic. ^S^fi:. •?-<7) 

i n 0 d e5'fflv>;&citcj:!!). 7 t -f;i'^MtiiS-t^>C: ^ii^'^f^^o 

[0 0 9 0] 

«?7> + -.?-7*->a hr-i l--^ h ') 1 3 3 05:: f^ftj LTS^ti;6o 77-^ ;KiO# 

i&tis ©KiT-o 77 -f )i (/.•>%mt^^-^m-> %</.■) 7 T ^ ^'/)^^.hi:'WoX<^>i^'&^t^i> 

V- g h ) t .^:M L ^j: if ii-if^j: hi\ ^h'^J:^^- ' ^''^ v F 5-^4^ ^I^Ti'^ifc '4>o ^ 
[0 0 9 1 ] 

L*-L-4^^^f>. 'P>lgtcif)^ailJl-Ci±. ?c,9tX"§:^$ilfc7-7. i n o d e^M n o d c--7 
:?7'140 0<?>inode tit L.'Cv>|l.li\ -r < U h 'J :^T-f/55^3TMfi0 7 r -f A'.fe* 
^i-<>7 T ^ H^J^y y •) ^Y^^Ti> (^6<0ffi^;^+ •;/-> 3 h f^' l'^- h ') 1 3 3 0 
f-) o C0O;&^(i. V-7Tft6!t?4t--t:^-1?Fil5li;t:-Jtv>o 7s t -/v' a h 7= -r I- h 
') 1 3 3 0 ±<^)^-<0 7 7 -f i — B^'T-'r l-^ h V </:)-i y h y t (7?^ t:. /-N- K ') y 1 3 
3 2tftg^t^ («aJx.<lE> UNIX (R) ^<-7.<r>')> i^'d^ 1 06^7 7 

l« i!l S CI i i) o j:.;' N •Jt-S-^)J: T UV' >'^'T«»ii:Ki:oT, -?-<7>j^ 

> f- 'J <±s -»6<)-f -f 1^ I- <) i 7 + V T'^- s V f- T -i I ^ I- ') S 7 r -f t 

UJ:oTjSL:^?ii&ii:lc^:-&o r'- 7s h 'j - Atejio;gaiU-B#6tif ^ v^j h')<0 50 
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■5?) JP 2004-389J8 A 20W,2.5 

^^ti-r^t) l.:0:«.'^i^:l-W.tiEt ('^c^)xy h '? c^) 'j ^ ^ 1 J':i±-!:-ab* ^:-(SS L/si^^ 
[0 0 9 2] 

i>-imi^i"4>'Z^Wk>^J:^^o PliSf-v ?£^fc<i. ?l^c7)7 r ^Pv';«.-f A;|^^^.^OJi*atl^si5^' 
[0 0 9 3] 

Ti hi^ h 'jXr-v 1 0 4 2jiv ^yj-'^^'t' (-H-rXT V/I 3 15) Ht-^ h 
)i^Knt& AC LRO^HT 7. h 'J-i^i/M^ii. iiS'Srijift^:;' rui&jMS'n*o 'e<^i2fe 

[0 0 9 4] 

V - /D -t 7. 1 0 4 0 !i, 7 7-1" r ^ V 1 0 4 4 (lA t5 , -g" iT-f-f l-- if h U ^ 

^m) x-iMify^o mi 5 a. v - T^'^-c^^mi r ^ ii-r- 1 50 2*»^2:tf?ti6 

) 2MB<Dr-i'i-X. JtiE;t;6 i n 0 d e ^-^l^iiD^T^o ii]Z^i"i>J^y h*) 1 4 0 2i± 
. i n 0 d e*7y7'l 4 0 0 o*^P^»bii&o ^cof- :5'5j»f3ii^'5r:*- 7-t v h 1 5 0 4 
:i^^^ai?*l. ^•^^:*^^Sc7)^fi0^^7^-^::' ■/y g v h 7 7 -f >H 3 4 0 ^ ii* ll.;g>o 
[0 0 9 5] 

•f 1" l-^ h 7. T - V 1 0 4 2 R'(fr- ^' 7, r- V 1 0 4 4 <7)|^if:> t^> i'^'C<r>r i U 
[0 0 9 6] 
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(2S) JP 2004-38928 A 20CM.2.5 

^ h >; Ji, MlC^^Xt 7 T'v 3 hc^)JV- h -T"',' N V (Q t r e e h) •C<fc«> 
o ?E:7fe>- h!i i nod e t f^Kp^^-f^^ V- ;^ ii^ifs^WtO- I- (>- I-^^pjif 

h :d«gt?f ;p - }" -7 V > 3 11.^ o -XV > T V .V - ^ T# i- ^ 7 r ^ >:^>*«E5fe V 
^.^:^(/^^i^tiil^itibK-PixXs R^i^J rn-irx t-, ^- e y Si *i, ^ ^ 

[0 0 9 7] 

tvT'vg ^Sfr•7'D-t7^S.^/sS•7^t ■;'•/->■ a hSir':^^ -h:^ li. ^■im-^'h"^\B^ 
T f y 7 7 -f -> ;^ -f A t^^^7s t y •/->■ 3 y b 0 i&:5lR) 

[0 0 9 8] 

0) o 

[0 0 9 9] 

*I-7 3-*;6 7^<:j6. v~ )\^,-<^/i^i)^^i>^^ii'6 (7x7^ -.vt'I 6 15) o ciC'^-ftli, WM:^ 

[0 10 0] 30 

ih^:}U-> (Ar-y7'1 6 2 0) .> ^ J; -p T ^ T ^ f / 7 T JW->;^-f I'ifjtlll* 
T ;v •7" (TI2:^ T l 6 2 5 ) X'Ti^-f -7'7 7 ■< }^'y T lsii-^h\%^ 3 * 
^2coxf;' /->3 •;' y\^U!^T^^^%him^jii.\m^'^^W^'hl^^i>. ?f3'S:^> 

Tf?lh?^^-^■.^'l ta^*r-|i«o -^ifef^l't-Jl, rSYSTEM AND METHOD 
FOR REDIRECTING ACCESS TO A REMOTE MIRRO 
RED SNAP S HOTJ i:Mt>i:±l£*iii^SSPt!l«gKiea?*iT</^-o<fc 0 rt^i- 
-f r-7r 'f i nod e ;^•y r 7'<r);tat>t'i=-j>!:&tp4^r'&iit*/\t*c: i: {•:: ^ 

ioT, T^/T'i 7*77 -f /'l^vXTAjcjttT'&7:?"tx4'J^^X5K- f ^ itr>: Xt* y 7'-> 

[0101] 

1?Jh? ■11:72 ^S^JtrrT^'r -f 7*7 7 -f JV->7.r Ac?? t *>«r)igiff lA'^^icftc 
r»2j (7)x^;^5K- ^$tl/^::^•^•;' ■7'v'a V h^^'pfigl-^, v 7* 1 6 2 5 ) ^ 
[0 10 2] 

^li:^^ -^^ •/ 1 5 3 0 r\ II 2 <5D;^•^ V /e/ g V I- i: ^ 1 <7)>^t T'v' a v y<f)^%^%- 
^:lt*T*o CiUi, ia8SO*[li9*#Mtr^±ie^.lgK^oTff'5:i.'V ^2<r>7.^y7- 
va V h^'^<-;^i LTfflvv ^ 1(7)7. t '/v' a ^-^r^^i L-Cfflv>;g>o ^XK:^t if 
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QSj 3P 2004-3e9?5 A 2004.2,5 

•? VP g h K^n ? n ^m. r% § i^j ? ^t.^ jc km^ ? n < x -f 1 5 4 o 

) o i ita^ # i ^t'il'II^^O*^ $> ^ts¥il<;>ircf.) T ^f- r / 7 7 -f ■> 7> 7" A <7>^i^^-C-^ 
[01031 

iJ^7 ■\z;(,ai^\C-r'i>m'^i>^''h (7s t -VT* 1 6 4 5 ) o L L 'Sr :!)^ , %^^L (TIfi 
[0104] 

«WBgU'5r*i:v^^,l^,■xf•afe<,^ S^j^t, ^^ML60:^lRl^ "T ?5: 1 * 6 -C ife * jS'- 

^$:-?-x.^>C t^^^'fci'^o ^NF S i'v -r T> Ki, i n 0 d e •?-<^7 r /K7)46^ 
t^r-^trTr-f *"'^> FH'tcJ:o-C> "r-f JW-T.^' -1:7.1' 4>o v- A-f i>5i»7 r -f ^I'S-;^ 
*LT=i'^«1-<>#'^. '?-c^)7 7^>i'{iSU<^ i n 0 d e/4^^7")V-^Wt<?> i tic's: 

0 ^<r)f:LiSy. NFS ^''^•'f r> h^i, 7 r ^ .vt 'J c - K (a< 4^-o,-t7r K;v 
UP|-r^->^ •;'-l:-vi-^-o) T^) it ^ < -?:<07 y-T JVtc 7 if -t x-f * C i S^r-g: 'i'/^o 

-C#;t^i:«>it-Ci«.o ^(i:>fzi>. k.tZ<r)%%^\.\,l. N F S T v h »Sl^a 4- til T 
C<»:^i!-<. -f*r-f 1^:^ I- 'J (Ci^ft? ^lycfittcT) 7 r ^r^fa^-^^ i ^»T-§ *o 
[0105] 

1 n 0 d ^'^-)>if§M 

— .<JS:K)?5:^^S L5r?iJSt*7^:«t>t::ii, v-7 t?G^C»F^l'C i no d e t •7*:^Si<S3{.iM 

0 d ^ia^Wtx nod e t -Sfc L.?5Jv>*-t>'C*;&o 15 CSfiT^^fev/ U 

Ui nod 6-7 7 T'sHtffl ^it, %§ML-<7>M. V-7s{i. M^a'-^MoTf r^i>Jb^5>^> 

1 n 0 d efi0l4M**y£t^7t:«;>(i-7ve>^"*:ffli/»;6'£-g^9^air);g>» L L 4^ ^) s 

t;: SI L t b ii> * i -J- I JE 4^ f;) 'Sf ^ -^^^^ <> 
[0 10 6] 

-j-7.^'i.^<r)\ nod e-7 v-7'5'^S)4t;6-:&g(iv •w7"x> hyc?) f^^J t'^^So 
@1 7!i. i(Z)EiK4'^;^1--&^)il 1 ^ ^^^mv:.m\^tz%><r>X:hi>,> RiiJiSf^, ilji 

XJA-:3t^*?i^'C) pg^Q^iU-. (xr\y7'l 7 0 5) o :^^c^ 5e^.1£0'7- xa, ^sd^v 
J^-v's LT i n o d e-7 •.v •/7 T-^ >^'«e^#^bV-7N{;:gJit4>o Z</)^-=ri^JL 

xr-y7'17 10) o iiiti;}?, i n o d e:{»*^^ja->i v-:^*-:|K^?ixTfe^$ix^-> 

[0 10 7] 

v-;^{i^ # i node t;ov>T 1 o<ox;/ h y t;t1-;6^<0 i n o d e vv7'7 
T-f v-;^Qt r e eUftJ^-T-o (xr-y/i 7 1 5) p :^'/>-C, Hrf.r'iJa^Ji. 
i} > ^"S: a = 1 (.r<?>^J^^^-) T?j!)IK^kt^ C^TVT'l 7 2 0) <, Nli^ 
^feQ t r e e±«^) i n 0 d e^t-Ut^^-^'ihix, 50 
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(30) 3P 2004-389?8 A 2004.2.5 

10 1 0 8] 

. ■^^■^^9t/mf-i^j:y - :^^^h<r>~^^ yy) iczi$i,fi>-^>^>m^i^^Mmf hitter > h')^ 

N§§«9 i nod e^liL/ii'^ ^Xi^. ^^f•z^j:M%ii^ ^</>^ ^^j:^> h 
fif i.»-S»-^*iJ^r& (^J|gf7.7^7 y 1 7 3 0) o h V»^^SL^:'/»#'a•^ Srnr'S: 

•J^. |frr^'S:i nod e v-y 7^7 7 Y ''UUi^t^-t^o 1 3i> t '5: a' ^> . Witz^^v -7>/-^>^> 

^4fc(7)Nti<7) i fio d e3«^|EL.,t^-6N ?;Jif7NT-^7'l 7 3 Oii7xr -.y/l 7 4 0 
'^iji L, ^IfKJji: i n 0 d e y T"? 7 -f ( 7x7^ -y 7" 1 7 1 5 CftE^ i <?» t 

nod e4'ii<a]*|frL.i'^?54fc (Si/>V-;^) i n 0 d e t'lv v e > ^^"t^o i^'^(ry%m^ 
%t LX. iwlfrr^'S: i n 0 d y ^li^^ y ^ > ■y^m^'f i>mkz'^ y y'<r>-kr.(ryy ■'i 

nod ev y /tciea$i*L/cgt^<^-enj^y ^ V> tTiS < i i: i^-* irit < 
[0 10 9] 

^V't^^JHl 7 0 Oi±. N:d^^i'^^^tG7r •I' .Vv^nt A(7) i no d e Li'^^-STi^-S' 
>• ^ -f?, (#|Sf -f V T' 1 7 4 5 ) o # L.*t^iJ<x i n 0 d e ^ V 7*7 r •< A'i3^%^ 
L. ^)li5i»'?-T-r-2-> (7sr-y7'l 7 5 O.l o MV^^ -^7 y \l > ■!rt^h i no d e>!)^?<^U 

■i}^>'$^^lfi\f4y^')^yit^ (y^T V/l 7 5 5 T-N = N+ 1) 
^ IDt«^-. ^ti^Ji i n 0 d e^^- y rtc-eoxy ^ ','a^t^^?tlr^#•a-i^ ^ !i 1 7 0 0 
?i|»;^'f -,v7'i 7 4 st^iS-iiiALv :^^'*-f ^'^''^^ f 7 5 5) 1r^-A-> 

>• ^ I- ? tlTtll^. ^llSiiXr ■/ 1 7 2 5 '9 . ^CLT-f > > h ? t'.fz Nt i 
<^ i n 0 d e^Jl-to 
to 1 1 01 

nLif. miS'd. 3 Oi7)1?lJgt&!ii:/ f 'M 8 0 2 V 1 8 0 45,?/ 1 8 0 6 ^-li^l-^ir 
. 1T!l•^&5)&$l'^M^ i n 0 d e •v -y 7 T )H 8 0 0 S-^^-t i (0 -Cife^o 7 - .'U K 1 
4 0 4 X 1 4 0 6 ( V - 7x i n o d e #-^,^y^'«E^fe i node . 1 4 0 8 ^ 141 

0 iV - HI 4 *#MtT±-e^^L/^o 30 

> f 'J 1 8 0 2 (i. (a v>) v-;^i node72:A^ (^^v>) i node605K'7 
ykiyy^ hi, zti:^l X>^> i-> ^ mm^^ . -x > f 1 8 0 4 Ji v - 7. i n 0 d e 8 3 1' 
fi^ i n o d e 3 2 8 iCT y e > i > h U 1 8 0 6 !i V - ;^ i n 0 d e 1 9 0 
^ i n 0 d e 1 5 OU^^ y k^yyt&o 
[0 111] 

El 1 9 iiv 1 7 0 0 (*|^oT> m 1 8 <7) t^i-^ i n 0 d e -v ■7'7 r ;H 8 0 0 

i-'h±^^n.fzm^&^j^j:¥tl'^> i n 0 d e^'? ■/7T ^' ,'H 9 0 0 4'^'ri<7> c:-cb-oo i 
<iO!^/c'&-7-y 7"7r -f *lr?{:*v-7 (Sv»^^) i no d e l 9 0 2 v 

5fe (S'/»V-7) i n 0 d e 1 9 0 4> ^ti^j:V-7. 1 9 0 6 , .?l 

?>\ fffT^l'&fa^t; (^i,^v-7) ^^#^1 9 0 8 J^Ol^T<^7-f -;i^K7?«t-^ *l^o 40 

<Oift:f:. $lrf^?5:y-7s i n 0 d e 1 5 OUMt<)-x> h U 1 9 1 Oli. iiS^t?l«S#U 
fr?t'>?e5fei node 1 90 (is J/!fe^§#) t'^TC^^x, ^tc (-j*tf>s 
liL/wv |g<c^?>^^?t'&V-;^ i node 151-372 b "M 9 1 4«0f^ 

.1 . |fr7t:'5:v-7 i n 0 d e 3 2 StcMT^xv f 9 1 2{i, |lr/^^5B76 i n 0 d e 
8 3 e > n;6o (•c^b;&*/r.t Ci-v -7 i n 0 d e 3 2 9 ~ 6 0 4 iZU 

T-oxy h 'M 9 1 S<^f^:v ^fz^j:V-7. i n 0 d e 6 0 5 IcMt&ji v h 'M 9 1 6»5 
fr;t«M^fe i n 0 d e 7 2 ? :^ H«>o H{C2b;s>v-7 i n 0 d eliv ii&<D^L 

7i nodeoOe {;r^t4>x> h 'J 1 9 3 0 t^^i-J: •) {!e'|igL.Tv»2>Si'^V-7 i 
nod evy -y (ISO 0) ±iz^/c^j:^% i n 0 d e3!>*^t:.<>-^ai?tJ.0:»-p/cli'a-U 5o 
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[0 1 1 2J 

G. i n 0 d 6*7 7 -fmit 

-ho El 2 0 ji\ %<r)y - :^ 2 0 0 1 :!^^ 2 oco^i?./ v 7* 5/ s v ?• . i" 

jSt^:) *>5e^ -y T'v- 3 y h A (2 0 0 2) ^(/^% -y .•/-> a -y h B (2 0 0 4) t 

-<i3:694^^-^2 0 0 0 ^-^i-^xOf^j^o #?Q4fc7N:f -y a -y hA&O^B ( 
2 0 0 2R0'2 0 0 4 ) 7C<^v-7.2 0 0 1 ff^^^^-^iirir- ^ Y ') - A(rM n 
0 d e 7 t:>'*^T^->«0ti^|/^<3*i*. i n 0 d e-v-y/AJK/B (2 0 1 251C/2 0 

1 4 ^^'^'j i^m^Aix^'^o 

[01131 

?e^fc:^t hA (2 0 0 2) ^Mt^^LTSS^fextvyf^s 

•yNB (2 0 0 4) K S.y-i:i^^'ti, X n iz. itii tTl.'^« i ii'Cab'&o U;J^U'5::!9« 

B£-t<>^-a-i#x.«^il<&o ?ioT. m^xt -^y->3 y hA (2 0 0 2 ) {i. 5E^;^t-y 

<t 9 7^ 2 0 0 2 Ji. -C-c?:) i n o d e y /a 2 0 12 $-5G5fcv Xr-i. 2 0 

0 4 {*Sj^i-^o >X^^X'?t%~y^-tJ-^ 2 0 0 4 !i> 2 o<7) >• 7n x A <?) i node Fa1i7)rjg# io 

v-X 2 0 0 1 <??'^?I*51-L-C§>fr(??:x9 -*#B?,-^2> J: ^ fCL/,:. i n o d e-7 

•y -/ASCFB (20 12X0=20 14) l'*t«<, 2o(/)'(|i;?y i n 0 d e v y T'^^fffi'T 
;2>^^. ritlf J "/D -b^s 2 0 1 6 'd^il h<Oi n o d e "7 v'/* 1 i nod c- -r^o'lpfBt 
Up'^.&o i c^) 13 -t 7. ti: , 7t<OV-7.2 0 0 1 i n 0 d eU•ol'^T, i n o d e 
-y^AJlCifBcfJ^^jd-^ i n 0 d e/i^fife##J ^-^tJtilT^ :^a'^T"i<7>yn-t 7i 
-e<0|lr?t:'a-V-:^*^ .|fr7t{c55iio'ttt>:^i;t i n o d e v y -7'2 0 1 8 fiT^t^®^ 
'5r^-y rtslt LT&Tc P^il-e -y /Js:. $ffr^?5: V- x^g|#-^(-fl3-r<>$ffn:^v-7.^ 
^#-f-:^'vt^ ;if!l § it., ? I i ^ I- ^jfiM 11 0 d e -7 V 7'B (2014) 74^ f;>]|i t) tiJ 

L./tlfrr^*5a^fe i n o d e/ifeB&t-ttiMaft*^-/^'? y k'^i^^S^Jt&c C<?>ffr^'5:v7 r » 
{i. ±ia^^Sfc^o-Ci^^:!jefa5fe2 0 0 4 Tl^ffl^H, If >^^:e#,"5J.c|3^-r;6fr*:^^■v- 
[0 1 14] 

mi. tfv V y y A t-ii ^<.•^ y «- X 0 S i n o d e 5 5 ( 0 S 5 5 ) 'v>5b^7. t- -y 
7'-> 3 -y h A«) i n 0 d e 8 7 ( A 8 7 ) U-v y \£y^^i:l^ ^? -y 7'B "CJi 0 S 5 5 55^* 
^^U%B<r) \ w 0 A Q 9 9 (B9 9) t'iv^y e>^^:&tlTV»^«|-6-*fe^i-;&o B tif;t 
'5:M:5fe(^L.. A$'#rr^'5:V^7.(::T<,/^i6(^{4, ?t;g^5|0S5 5 uSo'i/^T^^ c?)-? -y 

[0 115] 
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A o'^^frl-^T'O h'^- .a^-IS^^ji^i) Rrt^)5:^-f$. ^fe-Sl'^ti. K-? j^T i V 7 b 7 x 
[g| 2 ] It Se«0^iS?|^1^K J: J? la 1 (O3fga.t^dl||:;0* V - ;^ 7 T f JW^- ^t;5-.^9E^ 7 T 

& o 

[0 3 ] ^^^c^.)Sai-|I.^ST«> V - ;^ 7 T ''i'-^- -'<,^ y=5a^ 7 T -f .'i/-!}- - .'<t-^'tf. 

[13 5] 0iJ*to7 7'f }V->7.rA i n 0 d eWJ^ /n ^'@^^>^-.o 

[136] T.tv'T'S^a :v f- i n 0 d e ^^h. S 5 <iOWj^K7 r -Ov'y^'r A i node 

[El 7] ■r-^*' 7■D*;;^'75«»i§x.^b:|'lr^^i<7>|ll6<?>^JT^S<)7T^ Jl-->7.-fA i n 0 d e 

[IS 8 ] \v y V 3 h 5 - ;^ 7" D -fe CO V - ;^ -^^Mmi^i^^'^m't'^"^ d 

[EISA] m% (fyy^f- -y ^ ~j M 7- >:?'/D-t;:^tc^v^t: i n 0 d e^-ii^HT'D 
■b7s t ^{iav» fj, H iiJIf T - o 

[S8B] ia8A<7>i n 0 d e jf-^§*yD-t:x$-:^y-fliJ^6<)'5:'^- T'v 3 -y h 
D ^ l^CPSjS'^^t- V T'v 3 y Vr^yi' l'*'tifi^'5r^tB&lgl'^'<fe^->o 

[El 9] [g8^9X•:^-;' '/v' ay h 5 v - > ^''-z u-tX 1 1 ^t^^i*^ fj>i^.2> i n 0 d e 7 
-*-<7>^JS^6<)rS!!!at;^'tB&rD 111 •C-ifc-S-.o 

[S 1 0 ] V - 7> 7 T -f A'-^-z^X-^ V- '/v 5 V f ; 7 - U ^^'-/O -t7.S.U='^:5t;X t v:' 

[El 1 1 } 0iJ:^6t)^-fe^l J: V - X i 95^ ^ c^)W<07'- 7^ h ') - Atojs 7 ;t -^7 y 
1^ S-:^-?-* /'n -y tJ- llT"a6><>o 

[Ell 3] ^4fe^c43!t;£>:^ + -.^7*'>a v h 5 7- 'J > ^''T'D -bX<0:^T-->'5'gttl^/D 
•;'i^E|-t-<fe'&o 

[H 1 4 ] 0^^6<i*8sB^tiJ: <) v-;^ i n o d e i^%:^-ty T'v- a y h -5 7- {1-7 
}i>irt^fzi^<fy—m.t(^^4i i n 0 d e*7v 7't:^'r%:^n y i?|lT<fe<>o 

[S 1 5 ] ^4|c7^ t -.v 7' >■ g h 5 -<iO V - 7n t - ^' 7 7 .-f T^jl t'C v 5' fcf >- « 
it/i:t7-t V^<r>r~ ^774 Jl'C^)t§ll^l-*'tS«^T^H&«)'5rll-C-ab-6)o 

[Ell 6] n^^^^m^3A^ ''h -^-r y y B y 1-%^^ U^PMS-gtt 7 o - [g-c^2>o 

[@17] «1^S<)*gsf^lliJtl5 v-:7.7r-</Uv-;^'fA$:«£^5 ^'-Zv-g 1- 

[El 1 8 ] 017 <r>U.^.^mX"^m Hi, . U%^^i>nTr-^ i n 0 d e y 7'S-:^t% 
[Ell 9] 121 8<^Ri5#MSU<S:hS«.'^v-x (Ifrnr^rm^) ±U«^?3ir^0«:^« i n 
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SYSTEM AND METHOD t OR DKTmMINING CHANGES IN TWO 
SNAFSHOTS AND FOR TRANSMHTING CH/WGES TO A 

DESTINATION SNAPSHOT 

RELATED APPLICATIONS 

This (application is r&Isied to Uie foUowing Vnltcd Struts Patent ApplicatLoni;: 

Serial No. lAttomcy Docket No, 1 12056-0063], cmixl^A SYSim AND 
METKOO FOR ASYNCHRONOUS MIRRORING OP SNAPSHOTS AT A 
Df?STlNAT10N USQnO A prjfRGATOR Y DiT^BCTORY AND INODE VIAPPING, by 
Stephen L. Manlt^. ei ai^ the teachings of whicb ore expressly isioorporated heteia by 
teleretice; 

Serial No. [Attoixiey Docket No. 1 12056-0052J, entitled SYSTEM .^ND 
METHOI3 FOR STORAGE OV SNAPHOT MEIADATA IN A RJEMOTC FILE, by 
St)epheu L. Manl^^ ai » (bc^ tc^hings of which fi/e expressly ittcoTpor&tcd heceii) by 
tefeiecic^; 

Serial Mo, lAcConiey PocM No. 1 12056-0053 J, cntilied SYSTEM AND 
K4BTHOD FORREDrRECTING ACCBSS TO A REMOTE MIRRORED SNAPSHOT^ 
by Raymond C. Chen» et ai. » th& feacliirig;? of whtch are expieissly incoiporated tioitisi by 
i^ferenoe; 

Serial No. [Mton^fsy Docket No. 112056-0062], craved FORMAT FOR 
m^NSMISSlON or FILE SYSTEM rNFORMAllON BETWEEN A SOURCE AND 
A DESTINATION, by $!^hen L. Manky, et aly tbe teachings of which sat expressly 
inooipoTated hei«{n by jxikwncie; and 

Serial No. [Atuiraey Docket No. ! 1 2056^55], entitled SYSTEM AND 
METHOD FOR CHECKPOINllNG AND RESTARTING AN AS WCHRC«>^OUS 
TRANSFER OF DATABEP^^EN A SOURCE AND DESTINATION SNAPSHOT, 
by Midiaei Fedenvisch, et oi » the teachings of which are e^epqnessly isicorpo/ated 
hcjn&iR by reference. 
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FIELD OF THE im^ENTlON 

This invention cetiites to stortige of d&tii using file .^lorvei^ stid ntcre particuhrly to 
muTonRg or leplic&iion of stored <lata in fcsnote storage locations over a nenvosk. 

BACKGROUND OF THE INVENTION 

A iile server is « computer thai.proivi<ies file service leloiing lo ihc ong«itizdtioTi of 
mfonoaaiioit on storage devices, sudi as disks. The file server tyr filer include*? a t;tovage 
opcratit2g 9ysteiu that impicincnts -a iilc ay^xtm to logically organize tbe iofonnatloa as a 
hierarchicsi structure of directories and files On the disies. Each '*OA-disk*' fde may be 
iRipIemented as « set of data stmcttires^ e.g.^ disk bbcks» oorifigurcd to stwic inibrroation. 
A diroctoiy, on tlie other handj luay (k^ implemented as « spscially f»rmatt«d ftie in which 
iiifonnaiion fihout other files and directories are stored. 

A flier may be further coniigiizcd lo operate according to a cUent/sejrver model of 
information delivery to thereby allow many clienis tt^ a<x>cj{S files stored on a server* e.g., 
the filer. In tli!S model, the ciieitt may comprise an annlication, such as a databa;^ appii- ' 
caiioii, executing osi a computer that *'co«nocts*' to the filer over a direct connection or 
ccisnputer networic, such as a point-to-point link, 3h^Jed Uicai aiea network (I^\N), wide 
area iietwork (WAN), or virtual private network (VPN) implentciited over a public net- 
work Siicb as the Internet. Each ciiejit luay request tb?-. seivices of vbe file system on the 
flier by issuing file f»ystem protocol messages (in die fiinn of packets) to the filex ov-er tbe 
network. 

A coimnon type of file system is a "write b^fplace" file system^ an example of 
which 1% the conventional Berkeley fa.-jt file system. By "file system" it is meant genei'- 
aliy a stradunng of data and metadata On a storage device, sudi as diskfi, wiiich permits 
refiding.\vrititig of data on those <?;sk5. In a write in-place file system, the Ujcalions of the 
data stcnct^ves. Such as inodes and data blocks, on disk are typicaily Oxed. An iiiode h a 
data structure used to store itifonnatjon, such as metadata^ about a Hie, whcrea:; tiiedata 
biocks are sttuctwcs used to .store the actual data for dte file. The information contained 
in an inode may inciude, e.g., ownen^iip of the file^ access pennissiod for the file, sizt of 
the fik» i^Ie type and rcferenoes to locations on disk of the data blocks for the fde. The 

2 
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referei)ce^f to th« bcationsi of ttie fiU dsila. art provided by poinlcis in iftodt, which 
ni&y further rc^ermoe inJiim blacks that, in turn, reference The data blocks, depending 
upon the <|\iaiUity of <lata in the file. Cii<«xges to the ittodcs and data blockii fire m^idc *^n- 
piace'^ in accQfdsnce with Qifi write lii-pfaoc file system. If an update « file extends ihe 
quciDtiiy of data for Ifae ille> an sdditioua) data block i» n)1ucaitcd and the ^ppxoptiatf; 
incde ($ updated to refen^ce tltat dat£ block. 

Another type of file system is a vvTitt?-ni)>-vvhere fjle system Uiat does not ovei'- 
write data on disks. If a djita block On disk is retrieved (read) fiorii disk ift!o inefcory and 
*'dimed" '^-ifb new qjita, the data block is irtored (wiitien) to new location on disk to 
thereby optijni^je write perfomsafK^ A v^xite-aaywhere file system uiay ixutially Assume 
an optimal iayoul stich that (lie data is sufastantlaJJy coctigtiously arraoged on disks* The 
optiiDsl disk iav-out result*: m elHciem access operations, partioilaxiy for seqiiejotsal read 
opereitioiixs, directed to the disks. A patticiilar exampje of a vwite-an/whcte tile system 
that is couf^giLred to nperate on a filer the Write Aaywh«<^ File Layout (WAFL^«) Hie 
system avalabte from Ne^wrk Appliance, hic. of Sisnnyvale, Califcjniia. The WAFL 
f»tc systetis is tmpicineaied v^thin a microkeinel a? pswt of the overall protocol stack of 
the aiti and as^^iated dink stor&gc. TiJs mlcroke/cel is supplied tus pad of Network 
Applianc5e*s flftta ONIAP'*' software, lesidiiigoja die filcr> that pixjcesses file-service 
que^ from nervyockneittached ciieatsis 

An used herein, the term "storage oper^tij^ig sysrteiu" generally cefers to tiie com- 
ptitei'-executable code operable on a computer that maziages data access atid may, is the 
ca^ of a filer, iinplexneui fiie systtm seEtiantics, such as the Data ONTA?''** storage op- 
erachig systeni> iznple^xiented as a microkeinel, aiid available from Nctwxirk Appliance^ 
Inc. of Suiiiiyvalec California^ which implemenis a Write Ai^ywhere File Layout 
(WAFL^") file system. The storage operating system caii also be iinpiemenied as an ap- 
plication pro^m operating ov<ur a general-purpose operating system, «uch as UNIX® or 
Windows NT®^ or ^ a general-purpose operating system with cynfigiirfifolc functionality, 
which is cunt'igtired ibr storage applications as described herein. 

Disk stQrag,c is typically iicplemeDted as oncor niorc storage '^-olumes" that 
comprise physical storage disks, dednioi; an overall logical arraAgement of storage space. 
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Cuxrently available fiJer implciijciitatioriscan serve a large numbei- of discrcte wIiotcs* 
( 1 50 or moz«. for exomple). Each volume Is associated >»iih lU own file system aod^ fcur 
purpod^s hereof, volume md file system Bhall gfiineraliy used syaonymoii^ly. Tlie 
4i^s within a v^hune Arc cypicAlly oxgaiuzeci as ou« or more groups of Rfidiuid&iit Array 
of [ndq>sndent (or Inexpe^tsive) Disks (RAID). RAID implementatioos enhance the reU* 
abiJity/iDtegrity 5>f data $tojage through ibt- redundant writing of data **$iripM" acro5» a 
given number of physical disks in tlie RAID and The appropriate caching of p^^ity 
iniorcoation wilh inspect, to the jrtripiid data. In the exatnple of a WAFL fiic Rvstem* a 
RA(D 4 impleroectatioA is advantag«ou$sy employed. This tmplemcntatioii specifically 
entails the striping of data acioss a group of disks, and sqxvaie parity caching ^fsitidn a . 
selected disk of the RAID gioup. M dc^ibed hcftin, a voiunis t>-plcaUy compel at 
one dm disk aiul one associu$»d psuity disk (or possibly data'parsty partitions in a 
^iin^k di^k) arranged accoidiiEg to a RA1£> 4, or eqinv^tnt higb^r^iiabilit)-, impbnifinta- 
tion. 

In Oilier to improve reliability ami facilitace disaster recoveiy i(x the event of a 
failure of a fiUr^ Xt^ ftftsociatcd disks <x sotn'e poitiou off the storage mfkas(ructure» it is 
ooimnon to *'wiitFot' or T«phcatc some or all of the uj^dertying data and/or Lhc file syst&n^ 
fliat oigantzes (he data. In one QKsanp)^ a mirror is esiabUslied and stored ai a reinote 

makina it more likely that recovery 19 poiisible in the even; of a true dhja^ter that niay 
physically damage the maiii storage li>cation or it*s iiifmstnjctiiFc (e.g. a floods power 
outa^» aci of \^'ar, etc.). The mirror is updated at regular ijitervaLs, l>73lcally set by an 
adroiiiisiraior, in ssi effort to catch the rnost re<jent obliges to the file system. One com- 
mon fonn of update involve^ the use of a ''snapehot*' procesa in Vbrhich the active file sys- 
tem at the storage site^ ^nsisdnst cf inodei^ and b!odcs» is captured and the ""jnapshot" is 
traasm'med as a vAioie, over a network (sach as the welV^knowi hitemcl.) to tlic /emoie 
storage $ite. (lenoraiiy. a anapshot is an im^e (fypicaliy read-only) of a file system at a 
poiiit in iime> which is stored on the same primary storage device as is the active file 
system and is accessible by users of the active file system, by *'actjv« file system" it is 
nseant the file systei to which cuirent input/output operations are beiog directeil. flic 
primary stotage device, e.g,, a set of disks* stores the active file system^ while a sccon> 
dary storage, e.g. a tape drive, may be utili?jed to store backups of th<: active file sy^ein, 
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<)i)c^ snapshotted, die dcti\% file system is reestablished, leaving tjhe snapshotsed version 
in psaicc for possible disaster rcicoveiy. B^eh time a 8j»dp3lioi occars. Uie i>H active fiZe 
system becomes the new snt^shoi, asvd the new active file system cmita on, reccoding 
any new cliangex. A set mitsbeT of srijQpsbois may be retained depei^ding upon vai'iou$ 
time-hased and other crtteiia. The snapshofting pr(»cesfl is described io iiiilber detaii ic 
United States Pateni Applicatior. ScriAl No. 09/932,578, eutitied (NSIANT SN,^?&HO T 
by BLake Lewis e: ai., wliiQh is hereby incoipcrated by refeiience as though fiiiiy set forth 
herein, [o addition, the native Snapshot"^ capabilittes of the W AFL file sysictw aie &r- 
ther described Sji T^J002 Fih System Design /a- an NFS File Server Appliance by David 
Hit2; aly pubMwd by Network Applisnce, l!ic.» and incojnmonly owned U-S. Patent 
No- 5.819^92 enritied METIIOD FOR MAINIVVINING CONSISTENT STATES' OF A 
FJLE SYSTEM AND TOR CREATJNG USER-ACCBSSIBU< READ-ONLY COPiGS 
OF A f IL£ SYSTEM by Davi<i HItz etaU vvhich ^ hereby incorportitcd by reference- 

Tlie complete iveopyiog of the eiitiTe tile s>'slcni to a tcuit^e (destinaticiii) site 
over a network may be quite inconvenient where the size of the file systewi ts measured tn 
tens or bititdreds of gigabytes (even terabytes). This fiiili-baok.tip approach to remote data 
repHcatiozi Jtt^y sevei'dy tax the bandv^idth of the network and also the prooessiag c&pfs- 
bliities of both the deaiination and soi^tce filer. One solution has bct^i lo iiink the snap- 
shot to only porticos of a ille system voJume that have experienced changes. Hence, Pig. 
1 shows a prior art volvune^bascd mirroring where a source file %y^vsi 100 Is connected 
to a ae<ithiatio!3 storage ifite 102 (consisting of a server and attaciied storage— not showi) 
via a network link 104. Oie desiitmtioti 102 teceives periodic snapshot updates at aorne 
regoJar inierval set by m admhnstiatoi. These intervals aiDe chosen based tipon a variety 
of ciitetia including available bondwiddi* iinpcitance of ^vc data, frequency of changes 
and overall voiuine size* 

In brief sumniaiy, th<; somrce cseatet? a pair of timc^separatcd snapshots of* the vci- 
irme. These can be created as part of the commit process in ^-s'luch data is cotnniitted to 
non-volatile memory in the flier or by another mechanism* The "new'^ sraapsiiot U 0 is a 
recent snapshot of the votiinic^s active file system, Tlic "old'' sriapslioi 1 12 is an older 
snapshot of the volume, which shonki niatch the inia^e of the file s>-^em replicated on 

5 



http://ww4.ipdLncipi.go.jp/tjcontenttras.ipdl?N0000=21&N0400=image/gif&^ 6/3/2005 



Page 1 of 1 



(45) 3P 2G04-3S9Z5 A 2004,2.5 

the <katinatbn mitroc. Note, Thai llic fUc $erv«a* is &ce bo cdiuinue work on new fi!c 
service inquests once tiie ncv saai»lK>t 1 1 2 i» made. The isev/ siiapshol acto as a check- 
point of activit>' ?ip tt> thftl time rether thau an ah^iute repregeatation of «lu? ^cn-c^ureni 
vohunti^t&te. A clififertucer 120 scims the blocks U2 in the old aad snapshots. In 
jf>&Fticular> tfce aifferenccr w>r!cs in a biock-by-block fasbioii, exmiiiing tfee list of blocks 
in ejK^h snapshot to compare vA\Kh blocks have been allocated. In The <»f awrilc- 
aaywhere sy8*ero» the block is not reused a» long as a snapdsot references it» th^s a 
change in data is written to a new block. Where a change is idcntifie^i (tlenoled by n 
presence or absenM* of a« ^X' designating dataX a dccisioii piocess 200, shown in Fig. 2, 
ill the difT/bi^etKer 1 20 docides whctlier to troiismit the data to the destination 102. The 
process 200 compares the old aiid lit^' biocl?$ as foilows: (a) Where data is in neither an 
old ftor new block (caae 202) as in old/new biock pair 1 30. no data is available to trans- 
fee. G^) When; data is hi the old biock, but not the nev/ (c2»e 20^) fcs it i old'ouew biock 
pair 132, such data Jtas already been transterrcd. (aiad any new destination siuipijhot 
pointers vittU ignore it), so flie new biook state is not iransnaitted. (c) Wlicrc data is prea- 
ent in the both the old block and tl^e sievi/ block (case 206) as in tbe old/iiew block pair 
1 no change has occiined and tlie block data has a^j eady been tians^erred io a prevsou.^ 
ssjiapshot, (d) Finally* v^here the data is fiot in tlic old block, biit is in the new block (case 
208) as in old'xiev Week p^iir 1 36. then a changed data block h tiansfenx?d over the net- 
work to become part of the dxansed volume snapsliot set 140 at the destination aa a 
changed block 142. In the exciDp5ary ^^•Iife-anywhere an^igemeftt> tbe changed blocks 
are written to nev>v unused locaHonst in the storage ana>-. 0*ice all t^uuigod blocks are 
writiejj, a base file system ififoiroation block, that is the root pointer of the new snapshot, 
is ihexk t^inmitted to the destii>a\Jon. The lransmlit«d file system ioJfonitation block is 
committed, and updates the overall destinarion file system by pointing to the changed 
block stnictOTB in Oic dcstinatioa, and replacing the previous file system information 
block. Tlic cliangiis are ai this point committed as tiie latesi incremental update of the 
destiflaiton volume snapshot. This file system aocisraiely represents the "new'* snapshot 
on the sotitce. In time a new "new" snapshot is created from fxuthei; inciexnefitai 
changes. 

6 



http://ww4.ipdl.ncipi.go jp/tjcontenttrnsipdl?N0000=2 1 &N0400=image/g^ 6/3/2005 



Page 1 of 1 



(4$) 3P 2G04-3S928 A 2004,2.5 

Approachts to vo^ijinae-bRSPd lemotii mimiriiig of snapshots are described in do 
tail in commonly owned U.S. Patent Applicatioa Senal No. 27,497, ctidded FILE 
SYSTEM [MAGE TRANSl^ER by Steven Kleiman, e^al, said U.S. Patent Applicftlioa 
Seiial No. 09/426,409. entitled FiLE SYSTEM INIAGB TRANSFER BETttmN 
DlSSLVf [LAR FILE SYSTEMS by Steven KlciinaD, ei al,, both of which patcirfs aic ex- 
pressly mcojpomtcd hereia by refejr»cic&. 

This vohui(ie-b33cd appnoacb to incremeatal mirroring froiti a soiircc co a remote 
storage destiiULttock is effective, but may still b«t IsierficioDt and vfine-ccnsumiiig as it 
forces an ei^tiTC voli^ne to be .wnitfKxi for changers and thofie changes; to be txtuismitt^t] cn 
a block-ty-block biwi-s. In oiher woiuSs, the scaii focuses o». blocks wUhoui tcgand to any 
andtfdying iiifonnatioii about the files* inodfts and data stractiue^. which the blocks com- 
prises The destination organised as a set of volumes so a tlirect voJume-by-vohirae 
mappiag is established between source aiid destination. Aj^in, where a volume miiy 
contain a feiab> ie or more of mformation, tlie bIcck-by-bJock approach to scaiuui]^ aud 
coinpaiing changes xfi^y stMJ involve siginlicant processor overhead and associated proc- 
essing time. Often, there may have been only niiiKrf chanfics in a s«ib-h!yck beneath tlw 
root «wde block being .wumcd. .Since » iist of el) blocks iii the voiunie Is bein^exaiii- 
iaed, however, the feet that many grx;upicgs of blocks (files, inode «tructures^ etc.) are 
uiiclianged is not coiistdcred. additioD, the bicreus«tgfy large size and scope of a full 
volume make \% big^ily desirable to sub-dj\ide the data 1)eix]gmiiTored into siib-g;zoups» 
becaose some gi'oup? are more likely to imdei'go Sequent chanfjes^ it may be desirabk to 
update th&ir replicas more often than other, less-frequently changed gjoups. In addition, 
it may be deiurabje to nih^le ofigioal and replicated (snapsliotijed) sub-groupis in a single 
volume and migrate certain key data to remote locations without migrr^JAg an entije vol- 
ume. Accordingly, a more sophcsticated approach, to scanning and ideoti^in^i cliaoged 
Weeks may be desirabie» a* well as a stiVorgani^sition for the volwme that allovt's for Che 
ETiirronng of le^^s-than-an^entire voivmie. 

die swb sub-organization oi"a volvsne \^ the wcil-kaowii qtrec. Quees, as im- 
plemented on an exemplaiy stors^e syMem sucfi as desciibed hcrelA» a/e suE^trees in a 
volume's file system. One key feature of qtrees is that, givena partictslwr qtree^ any file 
or directory in the system can be quickly tested for mecnbersJup in tltat qtree> so they 

serve as a good way organize the file system imo discrete daia seT.i, The ot'qorees 
as a source and dcstitiatiotk for sitapsJiotted data b desirable. 
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When a qcree i« snsp&hot is implicated at ttte <j&stinati.on, it .is (ypkally m&dc avail- 
able lor <ii&&stcr cvcovcry and oth^r uses, suck ad Uata <^i$&ibiniOD. How^v?^, tbt; snap- 
shot lesidifi^ on the destination's active file systtm raay be in ibiz midst of receiving or 
pmcefssing an qxlitije trom the sovrce uoapshot when access by a ii8er or process i$ (It; - 
sired. A way to allow soapshoc to c^^mpldte its update wiUiout iaterfereooe is higlily 
desirable. Lilcewiso, whtii a snapshot mnsi rctum to m earlier staie, a way to efficieiuly 
facilitate a cetu^ or ""loUback.** is deured. A vaiim* of ocher techniques tor ma • 
lupolatifig dliferem point in tinao sikapshofs loay incite Htc veti^atrdty and utility of a 
snap^iioi: lepUcation awhanism. 

In addition, the speed ui T^iiich a destiitatiori snapshot may he updated is partially 
d€^nds upoA the speed 'wliit which change data can be cominitted 1ko7» the «oucc<e to the 
de^titiatltun^s active fUe -system. Techjaiques for Inaprovijig the efficietk^y of (ilc deletion 
acid oiodlficacion are also highly desirable. 
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SUMMARY OF THE INVENTION 

This inveDtion o^^crcoines fbe <]i$ad\-^tages oi'the prior m by providuig a system 
method for remote asyiiclironou!^ j^eplicaiion or mitwriog (^f changes in a souxce file 
system siiap&hot i» a destbation replica, ifil^ system u&ing a $can (via a softnner) of tbe 
blocks that m^c up two versions of a snapshot of ttw; soiircc HJc systeiijj which identifies 
chesngod Hocks in the {^speetive sruipshuC £iie$ based upoo-difibrences in volume block 
numbers idexxiified in a sc«n of ti>c logical jfilc block index of each snapshot. Trees of 
l>locte ajswciiitcd with the files are travet>;ed« bypassing tuichaeiged poiiitCTS betv^cen vei- 
sions and walking dtfvm in idcittify the changes in the Xiiei'archy of the tree. These 
changes are trar>sn)itted to the deaiixation minor or repikatcd snapshot. This tedmique 
allows r^u^ar files* directories^ inodcs and any other hiertsfchical stmctuie Co he efii- 
cicritly scasmed to deioimiiie difiemiciss between vei'sioiis thereof. 

Accosting lo ail n}usti^tivc«n;K»dmiei»l, che soiirce xcani!, witli the scaimer, along 
(Jie index of iogic-iil fife blocks for each sn^psaiot looking for chmiged volume bbck niini- 
bca s bctwccii the two source sifapshot^. Since disk blocks Qf& always rewritten new 
lociUjon3 ofi the dl^k, a diiTei:eac« iodicaie^ ciiaRgc^ m the uiulerlyijog lnodtiS of the re- 
spective blocks- Uwug the acanaer* liiadianged biocjts arc efiideotly overlooked, a? thcii- 
inodes are unchaxiged. Using an snode picker p!rocess> that recei^^'s chai iged blocks from 
the scsffliier ti^e source |nck« otit inode? from changed blocks specifically associated with 
the selected qties (or other sub-oigamzaikm of flie volume}. The pickei* |»ocess looks for 
versiuQs of inodes that have changed bct-A'een the two snapshots and picks out the 
changed version. If inodes an? the same, hut Hies have changed (hsLsed upon difrercL*t. 
generation numbers in the hiodes) th« t*j(fc versions of the respeotive iiiodes are both 
picked ovt The diangcd versions of the Inodes (between fhe two soapshots) arc queued 
and tr&nsfcTred lo a set ox tuode handlers/workers or handter^ that resolve the changes in 
iindcriying biooks by coiiUnuing to sum (^nth the scanner, again) file offsets down 
**tiees" of the inodes until differeaoes in underlying blocks aie identified via their l>lock 

fxjinteix^ as changed inodes En one version v/i]l point to different data blocks tlutn ^ose in 
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the otiier version. Only the changes h\ Ihc trtts at-e rransjnitred aver the network for up- 
date of the destination file system in ssik asynchtoaoiw (Iszy write) mamier. The <iesu»a- 
iioii file jjytiteni exported read-only flw user. This easwes that only tlie replicator cat) 
^Ittx the Slate of the replica iilc system. 

In ait iflitsti^itive embadiinent, a fiie system-XKdepewieot fonnat is usad [o trans- 
mit a daia stceaim of change dstttt over the netwoife. This fomiat consists of a se3 of 
stfifitblone headers Vfith uwque identifiers. Some headers refer to foUow-cia d&tz. and 
others cany reie^vant date within thcii* sti^eam. For example, ttie infoniifilioa reiaJirig to 
arT>- wirrce snapshot deleted files are carried within "deleted files" headers, AW directocy 
activity is tr^sismittcd first* followed by file data. Fj^e datji h »cnt in chu^iki of varying 
size, separated hy K^gul^r headers tintil an ending header (footer) i^: provided. At the 
destination^ the format is Jinpscked and inodes contained therein arc transmitted over the 
nerwrit art mapped to d new direct«ry sinictiire. Received file data blocks are wdtten 
jiccotding to their ofii^t in the coites|)Onding; destination file. Anlnode map stoics 
tries which map the sowrce^s inodcn (files) to Lhc destination's (nodes (files). The inode 
ma{> also contains generation niimbers. I'he tiiple of Qnode umnber, generation nnnibec) 
aSlows) tiw sy?tci^ tti cTTftAte a file liai-dle for liast access to a file. It altio allows the J?y&te!n 
to tracit changes in "whidla » fiie is <i©fcted and its inode number is i^asstgned to a newly 
created file. To jfocUitatie coostnictsoxi of a new director)' tree on tliC desdnatioii, an initial 
dii^ctary £ta^c of the destination mirror piocess receives somce directory infcimstaon vin 
the fozmat and moves any deleted or moved files to a temporary or "^purgatory^ directoiy , 
The purgatory fdcs which have been moved axe hard Unloed from tiic purgatory directory 
to the dir^ictorieji where they have been moved to. Newiy created sotu'ce files are entexed 
into man and bniit into the directory tree. A^ler fe dinsctoo' 15 built, tha tianafcr of 
file data begins;. <:haiiges io file daia from the SDiu:ce are 'vvsiiran to the corresponding 
t«plica files (as identified by Uie hiode map). When the data stream transfer is complete, 
tljc ptirgatojy directory is- i^mov*rd and any unJinked files (ij)clnding vAriwis deleted files) 
are petmaiwa^ deleted, in one embodiineni, a plurality of discrete source qtrees or 
other? sub-ci^anizations derived from different source voimwes cm be rEplicated/mirrored 
ou a single d&stirtation volume. 
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This ifiventioD overcomes rhe disadvantage of the prior art, iit a system aad 
method for u]>d»rii]£ a replicated destination file system snapshot \\*IS\ chsn^ta in ^ 
source file system snapshot, by fiiciy tfttuis constructk»i o( & ttw dkectory xv^ on tbe 
destifiaiion from souioe apdati^ bforniaiion using d teinporary or ''jpur^td'y** direccory 
that allows auy nxKiilSed and <feleted fUes oa lh«; destbiaiiofi active fUe system ifj be fUtfia- 
elated with (e,g, iicK>ved to) the purgatory directory if and imti] ihey are rx^wsed. In ^ddi- 
tion» an tnode map is esKablisbei! on the dt^stinatioa ihat iiiaps source inode numbers to 
dsstinatiop inode numibers so as to &ciiitace biuidmg of the desdnation tree v&ing 
inode/genci'aiion nambci' tuples. The iuode map aJlol^'s t«s)nchronizaiioa of the ^ooxco 
file system to the desdnation. llie t&odc map also altf)w$ »sdociAtton of two or oiore 
destination snapshots to each other based upon thdr respective maps viih the source. 

In a» iUustrats^'e embodimeAt, a ^e sy^ten^-itideipendeiiE forsnai is u$ed to oans- 
mit a data stream of changed fde data blocks with le^pein to a source's base and incre- 

meite^il snapshots. Received £Ue dan: blocks are ^tten according to their offset in the 
cx>ne£»po]idiiig de,-ittijiation file. .\t\ iaode niiip stores entries which ttKip the .<>otirce*s iiio- 
des (fUes) to the destination'^ inodes (files). The inode map also contains ^enerstioii 
Dumbess- 1'he tuple of (inode number, generatioa nuTuber) allows the system to create a 
file handle for fastaccciis to a file. It also allows the s>'st£tD.to track chahges io which a 
file i& deleted and its inode number is reas!»£&ed K) » newly created file. To fadlttatie 
constniCtion of a new dinectory tree on the dcstmatlon, an ioiiial director^' vtage of the 
destination mintor proce9.s cteoejves source direaory in^rmation via tl)e forinat and 
niove^ any deleted or moved files to die temporary or *'piirgatoiy" directory. The pur^a- 
tory t^ies which h»ve been moved art bard linked fiom ihe puigaiory directoiy to the di> 
rectories vhete they have bM^n moved to. Newly created soujvc 61es are enteitd into 
Kap 2;id buiJt iJito the dircctoty tree. After the directory tree is built» the tratisfer of file 
data begins. Changes to ille data from the source are wntten to the contspoading replica 
fi\ts (as identified by the inode map). When the data stream tian^tfcr h coniplcte, the p'-ir- 
gatory directory is removed and any unlinked files (including various deleted files) are 
permanently deleted. lu ocie embodiment, a phuaiity of discrete source qirees or other 
^Hib-organiziitian.^ derived from different source volumes can be repMcated/iTiirnved en a 
single destination volume. 
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In anorlaer ilfustrative excbodxTKni, the repticat&d file sysfftinis, kself ssttiKihotte^ 
thejreb> creating a first exported snapshot, llie fifsi exported .sn»pstK>t coixespunds to ^ 
fint state. If a dlsaftier or communicarloD breakdown occurs after fiirth^t tnodiiicatioBs 
or updates of the replicated snjipfthcn, ih\sn fufihcf mcjdification to ihe repJica fUe system 
i& bslvsdfkoz!^ and a DU\>fiequenl sccoad exported snajpsliat is creatml from the froxen 
replica file syMctD rcpres&ntmg tt» second state, Tiw replicated file system can be 
*toU&d back" troni die second 9taic to the fust state by decemuniiig she diftencnccs in 
data between the secostd state and the firat state and then applying those changes to recre^ 
ate the flivt state. 

In yd anottijar illustralive embodiment, the inode map itsed to map iaodes Uaas- 
teired from the source snapshot to iiiodc» in tbe desii n&fi<»i repUcar'sninor file system is 
used to r^Dchroiuzie source ^tabe with the destznadoc state. Th« destination be* 

cotnes a now '*$oiiroe'' and negotiates traiosf^ of the lAode map to the old **source'^ 
now the new* *^descinatk>A.** The received old inode map js stored on the source and ac- 
ce$scd by a flip pioccdure that gen&raies a new destinatioa map with N inodes cc|ual eo 
tli&nurnbear of Inodes on tfie nj&w sooroc, Tb& new de&tinaiton then creates entriei; from 
the stored source map for eadi iwv, dtsrtination assjociated ^vith the new soiu^ entr>' if 
available. Associated genecodoo Qtimbets are also mapped, (hereby providing tfa& needed 
file access tuple. Any entries on the new source index thai tack a new destination are 
marked a$ zero entnes. l^e completed flipped incde map allows the new soiuoe to up- 
date the new destiuKtion with Ixfi changed data. 

In a related embodiioent^ tvfo jEeplica/mirror saapshots of the same !«ource can tn- 
iflbtish a mirror relationship with one acotlier. As ix! the tli p cmhodiment abov%, the new 
**^souxce'' (old reptica) transfers its iziodc map to the destination aysiem. The destlnatiou 
sy54em then determinea the relauonshtp between Ute two system^s inodea- An "'associa- 
tive** piwess wa}ks the inode maps n the saioe time (e.g. concun'cmly, inodc naiober-by- 
inode nuinber). For each mode £rom the original aoui'cc< ttie prt>ces.s extracts tite **dc3ti' 
natson inode/generation" from each ot tSie inode maps. It then tre&bi the new source nst 
ttie appropriate mai^ inJe^ foi' the new inode map. It stores the t^w source generation 
number, aft well aa &it deatination inodc/gcncration* 
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BJWEF DESCRIPTION O* THE DRAWINGS 

Tlie 9h(yv^ and iwlhei ^vasitaees of the inventioji may becier uxtdctsiood by 
refening to tfw folLowmg description in conjuiicdon with the accomi»n>ing drawings in 
whkh like reference numersb indicate identical or fujictionaliy similar eiemencs; 

h^ig. 1, already dtscribcd» is a schematic biodtdia«raD^ of aa exemplary itmftle 
mi/TOfing of a vo) awe mj>5hot from a souix^e file server to a de^jtinfltioii file saver over a 
network XiCCO^dmg to 'a prior implenienfation; 

Fig- 2, already dc!)Ciibed» is a decision table used by a block difFereuoer of Fig. 1 
for detcnainifig whether a ^^hange in a block is to be tra^ismitted from the souroe file 
scrv^' to the desliuatioii file server accordiug to a piiar iizipleEsieatation; 

Fig. 3 is a schematic block diagram dexinbg iiii excmpiary network and file server 
enviromoeist mcluciing a soxjwe file server and a destiaation file server within whidi the 
pnncipks of this invention aie iK^lecnented; 

Fig 4 is a schematic block diagraxo of an exizsiiplasy stojtige oj|>easaik>& system for 
use Vfith the file servers of Fig. 3; 

Fig. 5 is schematic block diegrfim of m cxempbry file system iiiode stiXJCtiae; 

Fig. 6 i?i a schematic block diagi am of the ex£&ip2ary ule system inode stractmc 
of Fig. 5 Includjvtg a snapshot mode; 

Fig. 7 is a schematic bJcck <Uagram of the cxcmpiaiy file system inode structure 
of F'i^. 6 ailer data block has been rewrltteJi; 

Fig, 8 is a schematic block diagram of an exemplacy opeiation of the snapidiot 
ndnoring process at the jiouice; 

Fig. 8A U a decisi<Hi t&ble used in connection with sit inode picker proces? in tlte 
»\apshot mirroring process of Fig. 8; 

Fig. 8B is a mcire detailed sdtematlc diagram of an exemplary base snapsliot and 
ixjcrcmeiital snapshot block ilhwtfating the inode picker princess of Fig. SA; 

Fig. 9 i$ a $ciieniatic block diagram of an ex^^mplary opei-ation of an Inode vvof ker 
used in connection witli the .snapshot mirrortRg ptx>cess of Fig. 

Fig. 10 is a schemaiic block diagram of tJie sj()iirce fiie server snapshot minorion 
process^ the desei^iauon anap^ mir£onng process, and the ooinnuinication link between 
then); 

10 
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Fig. ) 1 is a schematic block disigxani of a staudaione hftaxkr smtcture for utse in 
ihf^ ciata stic&m n^smiasioD fo/omc between the source iincS the Uestiiiaiion acoor^mg to 
an illustrative embodimenu 

Fig. ) 2 is a schematic block diagx^i of the daii) stream traiisiui$sioii tbnnai 
tween the AOizrce aiid ttic desdnation accordiug to aa iilustrstive embodiment; 

Fig, 1 3 is a scheirtatic block diagjara of the stages oi the soapshotinirrojing proc- 
ess on thedesiinatioD; 

Tig. t4 i$ a schematic block diagratn of ageneTslizeci incKlc niap for mapping 
soui'oe modes to the destination snap^t inin'or accordiixg to a» tlltiutmtivc einbodinif^nt; 

Pig. 1 5 is a hi^y sdietnatic diagcam of the popuUtiOii of data files hi iSat desti- 
naiion siijipshot mirror at raappcti offocts with respect to source d»ta ftles; 

Pig, 16 is a flow diagram oi a snapshot rollback p-x)cedu/e accoidiaj^ to an illus- 
trative embodunetit; and 

Fig. 1 7 in a Ho^ diagrsun of a inode map Dipping provediu-e for roUing back or se- 
syiwlvom^trig tbe 30int;e tiic nyfOssiA to a state of the d&stinatlou (ninvyr ftn&{>3lwt acocrd" 
iag so an iUvstrativi^ embo^Um^pt; 

Fig. IS b a schematic block diagrwi of cxeiaplasy inode map residing on the 
destioation for use in the flipping procedure of Fig. 17; 

Fig. 19 is a sciicmatic biock diagram of exempiaf>- inode map constr^jcted on 
the old source (uew desdntction) oecocding to the flipping procedi;re of Fig. I S; 

Fig- 20 in a schematic biock diagram of a gtaicralizcd iood-i^ map assoctation proc- 
ess aocoiding to ao iliu.'^trativ'e embodinsecK. 

DETAILED DESCRIPTION OF .\N ILLUSTRATIVE 

EMBODIMENT 

A.. Network and Pile Scfve? £ftviconine>U 

By way of further bax;kgroimd» Fig. 3 is a scheinatic bJock diaj^rafu of a storage 
system enviroomait M)0 that includes a pair of ijJtcTcozmected j51e servers incltsditig a 
soured file scrvci' 3 10 and a destination file server 3 12 that may each he advantageo^isly 
used wirh the present invejidoxt For the piuposcs of this description, the source file 
server is a actworked computer that manages borage one ormoie source voiitmes 314, 

IL 
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«ach having m may of atoiage di&ks 360{-dcscrir>ed fiirther below). Likewise, ihe destx- 
ikadoft flier 3i 2 manages ooe or nV)re deatination volumes 3 16, alsto comfynsing «zifty& of 
<tisks 360. The sjoutcc and destinatioo file sei-vers or "filers'* are linked via a necwork 3 1 S 
ctat cart coFxiprise a local or wide area netwoirk^ such tfie wcll-kncm Lotemet. An ^p- 
propFidie network adapter 330 residisig in each filer 310, 312 facilitates communication 
over The netwoik 31 $. Also for the pm poses of this description, like coinpouenis in each 
of ihc sc-urt* and deistinaiion filer, 3 10 and 3 12 respectlvdy, arc described with Hke ref- 
ererxce uuinerels. As used herein^ the terai "sou/cc" can be broadly delwjed as a location 
from which the subject data of iMn in-v^iitioii ^vel&and ihe teim ''destination^* can lie 
defiiidd 0$ the location to which the data travels. While a sovsct ttler and a destttiation • 

connected by ^ network* is a particular example of a ^m'oe and diestiTj^on used 
hctci^ a source ^nd destuiation cOoId be con^puters;fikr$ linked via a direct link, or via 
J<>opback (a '*iietworking" an-angement internal to a single computtr tor Uansmitting a 
data stream betweeii local source and iocat dcstinalio!))^ in which case the souivx* and tlie 
destination aie the same filer. i\s "will be described further below, the source and desti- 
nation an: broadly coii'ddered-to be a soucee ^ub-oigan (nation of a volume and ades^na- 
t(on siib-oi^ganizaiion of a voiursie. Indeed* in at least one special ca?e the source and 
destinfttio^n sub^orgasadzanous can be the sante at diirercnt poiata in tii»e. 

In the panicular exaxiiple of a pair of netwotked source and destinatiouc filers, each 
€ler 3U> and 312 can be any type of special-pu^pofie computeu' (e.g.» server) or general- 
purpose vomimtev, including a staodaiojnc computer. The source and destination filers 
3 1 0, 3 1 2 each coiiiprise a processor 320^ 3 ntesnoiy 325, a netwtjrk adapter 350 aod a 
storage adapter 340 interconnected by a system bus 345. £ach filer 3 10. 3 12 also in- 
cludes a sjorage operating system 400 (Fig. 4) that impleiiiciits a file syt^texc to iogicaliy 
organize Lhe infbmiacion as a hkerafchical ^ucture of direct<)rie3 and files on tl^ disks. 

It will be understood u> those s^killed in the ait th^it che inventive technique de^ 
scitbed heietn tnay apply to any type of special -pQipose computer (e.g., iile serving ap- 
pliance) or geaeral-pui]>o^e oornputer, ijnciuiling a standalone computer, embodied as a 
stoTi^e $y$Leni. To tliat end» the fiiers 3 10 and 31 2 can each be bioadly» and altera- 
tively, refencd to as storage systems. Moreover, the tcachiiigs of this isivention can be 

adapted to 8 variety gf storage £i>^tein architectuties inoiv'diixg, but ni)t limited to« a net- 

12 
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w<>ii-aiit\ciiie<l sioi^e ettviraiunerf. a stciage area nct^^'ork and diskassKsmb^ dirtctly- 
' attftchedioacJieritlioslconiptiicr. Ihe teiin ''storage sysieffi'\saouJd, thwcfore> 
bruadly- CO include siidi ausnxgemetits. 

In *e illQStrati^-e embodimetK, the ojeniory 325 comj^ises stozBge locatimw that 
are addressable by the processor a?id adapters for styriug software piH>giam code. Tbe 
memory compriscH a fiain of raridcmi access memory (RAM) tbat is geneiidJy cleared by 
a Ijower cycle oj- other reboot operarion (i.e., h is "volatile** memory). The pTocesstyr and 
adapters me^, turn, «>mj»i«e processing elements and'or logic circvitry configured to 
ex.<»eute the softwflic code axid manipulate tbe data siniGtures. Ttie opera^ng system 400^ 
pojrtiOT» of which aie typically resident in niemoty aiwJ esteciitad by the processmg de- 
meai5» fbactiooaliy Drganizcs thfi filer by, imer <Uia, invoking stanige operatiom m sup- 
port Ot a tile service implemented by the filer. It v^ill be apparci)! to those skiUcd in the 
an tbfii other pcocesstAg aiid memoty me^, induding various computer readable media^ 
niay be used for sic»rhig and execiitieig prograna bsttuctions pertaining to tbe inventive 
lecbniquc de!»onbed heretj). 

The ncnvork adapter 330 compH^es tlic mechaoicaJ, eJechical and sgoaJini^cir* 
cttitry jieedodto connect each filer 3iO, 312 to tlse network 3 JH. v.-hich niay comprise a 
polnt-to-poim coonection or a shared mediUM, sucb as a local area network. Moreover 
the i^urce filer 310 may iniexact with the destination filer 3 12 in accoxdance with a cU- 
<»tftecv©r model of infoimation delK-eiy. Thai is» the client tnay request the ser\ice» of 
the filer, and the filer may return the results of ihe sei'vioea reqi^ested by tite dietil^ by ex* 
changing packeta 355 encapsulating, eg., the TCPAP ptotocol or another netsvork pmio- 
ool formai over the tietwork 318. 

The stornge ada|>$et 340 cooperates with the opciaiiiig sysfem 400 (Fig. 4) exe- 
cuiing or; tlie fiJcr to acccsii infbnnation requested by tJie cHeni. Tiie iixfoimation niay be 
stored on tho di^ks 3^0 that ar& attadied^ via tbe stoiage adapter 340 to each filet 3 1 0, 
3 1 2 or other node of a storage system as defined herein. 7he stocage adapter 340 in- 
cludes iiipttt/owtput (I/O) interface circuitty that coup^CiJ to the disks over an I/O inter- 
cotmect '^2n»euaent, such as a conventional high-perforoianGet fibre Channel serial link 
topology. The faformatioii is retrieved by tlie stfirag^ adapter and p.'vjcejiscd by theproo- 

13 
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eswr 320 as part of the sisapsbot procedure, to be tJescribcd t^low. priHT to being for- 
wanled ov<;r the system bus 345 to the RC!work wiaptw 330, where ciio iofoimation h 
formatted into a packei snd ^«iismf ttecl to the destinatioA server a& «tso described in cis' 
taiJ b^bw. 

Each filer may also be intcrcoruwcted with one or more clienrs 370 via the n«- 
wjrk adapter 330. Tiie clicats transmit itquescs for file service lo the s(>iu:ce and destifta- 
tioa filers 310,31 2. re$pectj vcly, »fid receive respomcs to the ceque^^ over a LAN o,- 
othef network (3 1 8). Daia is trai^sCerred bti-jvecii the client a»d the TCSjKsctive flier 310, 
312 wing data packete 374 defuaed as an eiiciqxsittatlon of the Comrnon Uiteniet File 
System (CIFS) protxipoi or ant^ther appropriate protocol $ueh as NFS. 

In one exeppl^iy filer unplemencatfon, each tiler 3 10^ 312 can iaclude « iionvola^ 
tile random access memosy (NVR^i) 335 thalpjcovidcs fiiuit- tolerant backup of data, 
cnMing the integrity of filer transactioD:? to swive a savke imteanptioQ besixl iipoii a 
poT^'er iailuxc, Of other iaulT, The of the NVRA^I depsnd.s in ]>fiil Mpoii its Impie^ 
meni?JtiojQ aiid iunetion in the file server. It Is typicaUy sized suliicieiitly io k)g a ceiiain 
tiii3C^b^$:ed chunk of tnmsacticns (for cxampie, scvcna! seconds wordi). The NVRAM is 
filled, in ixarallel with the hiiifer cache, alter each client resquesi is cosnpleted, hut before 
the result of ihe request i$ returned to the requesting client. 

in an illastrative eoibodiinent, Hie dbk? 360 axe arranged iotc a plurality of vol- 
mn&d (for example, source volumes 314 and destiiiatioo volumes 316). m ivhich each 
voiuioe has a file system associated therewith. The volames each ijiclude one or more 
disks 360, In One embodiment, the phy.^ieal disks 360 are ooniiguced into RAID snKxps 
so tliat sojifcfc disks store striped data and some disks .store separate parity for tlic data, in 
acvoi'dance with a piefenred RAID 4 coDfigiiratton. Hov/cver, other oonuguraiions (e,g. 
RAID 5 having distributed jwrity across i^ipcs) are also contemplated, bx this embodi- 
ment, a hiinijtium of one parity- disk and one data disk is employed. However, a typical 
iinplementation may include three data and ocje parity disk per R-^ID grotip> and a multi- 
plicity of KAID groups per volume. 
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B. Storage Ooftratiaa System 

To facilltjitc generalized access to tlic disks 360, The srora^e operating system 400 
(Fig. 4) iinpienients a wdtc-anywhrn fik systen^ thai logically 0TS^7jes the iQtbrmatjon 

^ hierarchical ^ructuie of directories And f-ies on tb£ disk5. £acb "oji-di$k" ftlo may 
be implemented as a set of disk blocks coiifj^uied to s(or& infbnTiatiaii, »»ch as (laia, 
wjiereias the dbecioiy rnay be iinpl6n3«nted as a specially formatt^ file ill which fftfer- 
ences (o oihci* files arid directories ai^ sjoced. As noted and Jeftjied abovt\ in tlie illu*?- 
iTiitive cnibodimeut descnhed herciri, the sloifkgc operatsag sysleiut Is ihe NetAp(>(S> Data 
0>3T<\f"'*' cipemtiag a-ystcm av£dlai>Se from Neiwork Appliance, Inc., of Sunny vaie, CA 
that iiziplemenis the Wiite Anywlioe Flic Layout (WAFL^"*) file system, h is t^pi'issly 
coiiiensplatcd that osy appropnatc file system can be used, &r<^ as such, wh&re the ten» 
"WAHwr"' i:; employed, it should be taken broadly to refei to any file system that is ocher- 
vvise adaptable to xho teachings of this i»veotion. 

'Ilxe organization of Jhe pi>eferred storage operating system for each of the exerri* 
pijjry fitexs is isow dc&crib^ briefly. However, it is expressly coatempjated that the prin- 
ciples of this tnveption can be implemented using k variety of alternate storage opeiatnig 
system architectures. In addition, the particular fiinctions Impleoiented on e&ch of the 
source and destination filers 310, 3 12 inay vary. As sbowii in Fig. 4, t))e exeinplai^' str^r- 
age operating system 400 comprises a seties of software iayers, incliidiitg a media access 
layer 405 of >istwork drivers {e,g,, an Ethernet driver). The operating isystem fiEither in- 
C'Ktdes network protocol layersv sucb as tlie luternel Protocol (iP) layer 410 and its sap^ 
porting trait^>ort mochantsins^ the Transport Control Protocol (TCP) kyer 415 and the 
User Datagram PixjtocoJ (iro?) layer 420- A file sysicin protocol layer provides multi- 
protocol data access and, to that end, inoJudes suppon for flie CJFS protocol 42^, the NFS 
protocol 430 and the Hypertext Tjianafer Protocol (HI TP) protocol 435. In addiiion, the 
storage operath]g systttn 400 inchides a disk storage layer 4^G that impj«ment& a di^ 
atoragc protocol, sijch a RA^D protocol, and a disk driver layer 445, that iRiplement? a 
disk control protocol sitcji a? the sinaU coin]7uter system interface (SCSI). 

Bridging the disk software layers with the nctwrk tmd file systcrtj protocol layer?; 
is 0 (lie system layer 430 of the storage operating sy^ttcni 400. Generally, the layer 450 

15 
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Implememi! & tile ^slcm t^iig An on-dL'^k fontkat repx^tstuitation thai is block- V<t99d us- 
ing, e.g» ^-kilobyte (KB) daui blocks and using inodcs to describe the files. lit jcupon^^ 
CO traitsactioit J^uescs^ the file system senerates opeiitltons to load (retrieve) tbt tt- 
ques«(»i data from volumes if it \s not j'esideat "iii-core", in the filer's memory 325. 
If the infonnailon is Dot la memory, the fiie system layer ASQ indexes into the icode file 
using tiie iaode iiimibei to access an appm^priate eatry aiicJ retrieve a volume bloc^c num- 
ber. TKe fite systm ia^er 4^0 {{kh pa$ses the voluiAe block nucab^ to ihe disk ssotagc 
(R«\ID) layer 440, which maps; that voiiune biock number to a disk block nibnber end 
swids the lATter to an appropmte dri w (for example, ao encapsulstion of SCSI imple- 
me(tti»i on a fibre chdtukel disk intercomeetion) of (he <li3k driver layer AAS, l>i.e disk 
driver accesses the disk block nuitiber fmm volumes and loads the ie<|uestjed ;iat4i in 
memory 325 for processing by the fileaf SIC, 3 \ 2. Upon completiom of the tequest, the 
filer («od storage operating $y£teir») rdnnis a re|;>Iy, e.g., a conveiitiorml acknowfedge- 
mcul piackei 374 defined by the C^FS specification, to ti^ cfiens 370 over the rcspcvfive 
network connection 372. 

it should he nt^tcd thai tlse so.^ware ^^nath" 470 tUrottgh t Jw storage opemsng sys^ 
tern layers describtsd abtjve iiocdcd to perform data storage access for the clieR* roquesl 
received dt the filer aiay alsemjaively be imptemcnted in hardu'are or a oombination of 
b^knlw^Tc and software. That is> Ln an alternate embodiment of tlte Inverulon, the stoie^e 
access request data path 470 may be iuxpieanented aii logic circuitry embodied >vithin a 
fj^ld piog»mmaWe gate array (FPGA) or an applicaiion specific iiUegrated ciratit 
(ASIC). This type of hardN^-aie hnptementatlon iacreascs the perforxnajwe of the file 
acrvtoe pixrfld^ by fsJer 310, 3 12 in re^nsc to a file system reqiiest |«ick£t 374 issued 
by tlie cliciiit 370. 

Overlying the file system layer 450 is the snajjshot miiroring (or replication) ap- 

pUcalion 490 in accordance with an illusjjattve cnibodlnaent of this inventJoa This ai?- 

piication, as described in detail below, is responsible {on the soiirce side) for rhc scanning 

and tran&mis&ioii of changes in tijc snapshot from the source tiler 310 to the destination 

filer 3 1 2 over the network. This application is responsible (oii the desiinatior side) for 

the generation of the updated mirror snapshol irora received infonnation. Bence^ the 

partictilar fisDction of the soutw and destination applications iue different , and arc de- 

16 
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scribed as moh below. The sziapsbot miTroring application 49(i operates outside of die 
iiomial reqi^esc piith 470 as shown by the direct Jinks 492 and 494 to tlie TCP/IP layers 
415, 410 and the Hie systom 8iiai»hoi mecl^anism (430). NotftKly, the application inter- 
acts with llie fiJ6 system iayer lo ^aiii knowiedge of tiles so it is able to use a.aLt>based 
datA structure (inodc; Hies, in particular) to replicate souite ^nap.^K<>t3 &t the d^iinBtioiL 

C. giiapshot ProcediBies 

'Hie iTihercnt iSnapiShoL^^ ct^pflbiiitles of thecxe»tplary WaFL f(te system are 
Either cicscrit»d in TI{3002 Fik System Design for wt NFS file Server Applhnce by 
David liitze:al.. mbiishsd by Network Appllmioc, Lie. which is hereby incorporated by 
reCereoce. Note^ "Stiapshot" is a trademark of Network Appliance, Inc. It h u^d for 
pjirposcs of tM* patent to designate tt pcrsisient consistency poiot (CP) imago. A pciiis- 
teat constaency point image (PCPI) h a point-iti-tiitte representation of th« storage sysr 
teni» and more pdrticulorbv of the active file system, stored on a storage device (e.g,. on 
disk/ or in other peirsi^ent menaocy md haviiig a name or othi^ tuiique identijient that 
distinguisher, it fTOin olhor PCPIs taken at other points in liinc. A PCPI cai> atso !iiclu4« 
other infcnriation (nietadata) about ibc active file sy&tem at the particuiar poiiiif in rime 
for vt'hich the image is taken. Tlte terms "PCPI" and "snapshot" shalt be ijsed <»ier- 
changeably through ot»t this patent without derogation of Network Appiiancc's Irademaik 
rights. 

Snapshots ait generally ci^ted on some regular schedule. This ^hcdule is sub- 
ject to great »'ai'iation. In adidition^ the duinher of snap^iots retained by the Uler is highly 
variable. Under ooe storage scheme, a nwnber ofioccnt snapshots are stojced insiK^ocs- 
sion (for example, a few days worth of snapshots each taken at four*hcur iiners.'als), aiid a 
jitimber of older snapshots a^e retained at iiKireasing time spocings (for e)&8inp1e, a nmn- 
bcr of daily snapshots for the previous veekC&) and ^;tfeekiy 5'iapshot for the previous few 
moni.hs). The snapshot is stored on-disk aloiig with tlw active file system, and in called 
into the buffer cache of the filer menwry as roqucsled by the sto^e operating system 
400 or snapshot mimor appllcatm 490 as described futther below. However, it is con* 
lemplated that a variaty of snapshot vreatiofii techniq^ies and timing scheme<^* can be tm- 
plemenied within the teachir^gs of this invesation. 
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An cxcnipiary file system inode sDiicture 500 according to aij jllustr^ivc cm- 
bodimei:;t is shown <nFig. 5. Hie inodefor the inQtkjih oi more generally, ike **roor 
inosle 505 coital Pi^ mforTtiation describing fhe ixiode file 508 sssoctared with a given file 
ftystiCir:. in ihis excanplary f^t. system inode s»ructune too! inode 505 contains a pointer to 
Ihe ittcde file ifidirect block 5t 0, The inode file indiiect Mock 5 1 0 points to one or more 
inode file direct btockjj 5 12, each containing a set oi poiuters to in<xJc5 51 5 tliat make up 
the inode file 508, 'flte depicted subject inodfi file SOS is organized into volume blocks 
(not jjcrxiiraicly shown) made up of inod«? 515 which, in Uim, contain pointe-is to file data 
(or "disk") blocks 520A» 520B and S20CX In the diagram, fbis Is simplified to si)ow jnst 
the iiK>deitsejfcoDiaimngpoincers TO the file data blocks. Each of the file d&tabJocks . 
520(A«C) is adapted to storey in the iJJiistratJve embodiment, 4 kilobytes (Kli) of data. 
Note, however, v/hm more than a pradetermined number <}f file data blocks are lefer- 
eacjed by an ioode (515) ooc or more indirect blocks 525 (shown in phantom) a-c u^, 
H!c.sc indirect blocks point 10 as$ociated file data btocks (not 2ihuwn). If an inode (5 \ 5) 
points to an iiMiij«ct block, it cannot also poiiii to a ille data block, and yict v^rsa. 

Whrai the fij;; systcni gcEKxates a snopshot of a given fSlc system, a snapshot inode 
is g^terated ss shov/n In Fig. 6. 'Hic liiiapstsoc i&ode 605 is, in essence^ a duplicate copy 
of tlie root hwk 505 of file system 500. Thws, the exemplary file system j^tnteture 
600 includes the same inode file lidirect block 5 10^ itiode xile direct block 512, inodtis 
51 5 and file data blocks 520( A-C) as, deleted in Fig, 5. Vtlvm a v^ises: modifies a Sle data 
block, the file system layer writes the new data block to disk and changes the active file 
system to point to the newly cteatod block. The file layer doc^ not vinrite new data to 
blocks wiuch are contained in snapshots. 

Fig. 7 shows an exeroplary iisode file system sUiiCtwre 700 after a file data block 
has been modified. In this illnstrative example, file data which is stored at disk block 
520C is modified. The exemplary WAFL .6le system -Atiies the modified contents to disk 
block 520C', vtfhich is a new location cji disk, Because of this new l:?cation, the inode file 
data which is stored at disk block (515) is rev/rltten so that it points to block 520C'. Tins 
modificatiOil causes WAf L to allocate a new disk block (715) tor the updated version of 
the data at 5 ) 5. Similarly, the i node file indiivct block 5 1 0 is rewritten to block 7 10 and 
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direct biock 51 2 is rewritten to block 712, to point to the newly revised inodc 7iS. Thus, 
after a 01e <kta block has been iiKxiifi«d tiie snapshot lao^e &J5 ccmtains a poitna- to the 
ortgirt^l incxklflk system indirect biodc S 10 -which* in torn, coniains a Jink to the i»ode 
5s 5. Ttd& modo 5) 5 contains pointers lo ibo ojigioal f^le data blocks 520a» 520B and 
520C. Hovircver, the newly written icode 715 iiiclwles pointers to luiraodified file djstft 
blocks 520 A mi The i»oUc 7] 5 air/) contains n pointer to the fnodiHcd file Jata 
block 520C' represendng the new arrangem^U of the active file systeut. A uew file sys- 
tem root iiwcie 705 is established reprtjsenting ths; ntw atr\icture 700. Note that inefettdaLa 
in any snapshotted bloclcs (e*g. blocks 5 10, 5i 5 and 520C) protects these blocks from 
being recycled tvr overwritten until they are released from all snapfihots* Thus, while (be 
active file s>'stem root 705 points to new blocks 710, 712, 71 5 and 520C\ tlic olc blocks 
510> SIS and 520C areietained until tm stiapshot h fitUy rdea^. 

In accordance v/ith an tlhisrrative einbcdlment uf thi« invention the source uliUzcK 
two .sjiapshots, a "base" .snapshot* which repr^Dts the image of the replica fii^ system 
oaTh« destination, and an ^'tnccementaS*' snamhot, >vhich is the image tlrjat ihit sotttce 
aystcm jiUcads to replicatt Co the desci oatioii; io per«>n« iieedcd updates of the leiiiotc 
snapshot minor to the desiinatiou. in one exampte, from «hc sttaiidpoinl office scuitc; the 
increntental snapu^^t can comprise a icost-^recciit snapshot and the base can comprise a 
(ess^reoeat ^oapshot, enablinn an up-to-date set of changes to be presented to the destina- 
tion. 'I'his procedure shail now be described in greater detail. 

Having dcwibed the general procediuie for deriving a snapsliot, die leiiTorisig of 
stiapsliot infoxxnation hotn the source tzier 310 (fig- 3) to a remote destination tflet 312 is 
described in ftirther detail As discussed geiieially above, tije transriiission of incremental 
chang,es in snapshot data ba»ed upon a comparison of chaAgcJ blocks in the whole vol^ 
iirne is advantageous in that it transfers only incremental changes in data rather than a 
complete file system snapshot* iliereby allowiiig updates to be smaller and faster. How- 
ever, a more eMcient and/or versftttie procedure cor incremental remote update of a desti- 
nation mirror .snapshot is coniemplate>d according lo an ithtstrative embodiment of this 
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mvecfUon. Noie, a» used herein the texm *'repUca snapshoC* "replicated snapshot'* or 
"Mirror stuipshot" shall be taken io slso nfet g^neraUv to the ilie system on die destina- 
Tiosi voJuzne^at contains the snapshot >^here; appropiiatie (ior«xmnple v/hcve^ snapshot 
of a snapshot jjj implieii. 

As indicatixi above^ it is conf^nplateil ihst ihis procediAFS can take advantage of a 
siib-orgaiL'zaticJi of a volume knowti as a qti^, A qtw acts siiuilariy to liinits etitbrced 
on coU«ctio»? of <i«ta by Ute size i)f « ptutilion in a ttaditioital \)m)tiS> or >Vindowa(b Hie 
system, bat with ih$ flexibility to subsequenrly cbaitge tJie limlU ^ince qtrees have iito 
comusction to a etpccific l angc of blocks on a disk. l^iUike volumes^ which ait mapped to 
particular collectiojns of disks (e.g, RAID flwiips of k di$k$) and act. more like traditioi>aJ 
partitions, a qtree is impiemeiued at a iughei" level than volumes 8«d can, ibas, offer nioiti 
flexibility. Qtrees are basica]ly an abstraction in the software of (he storage operatbig 
fi>rstem. Each volume roay, in fScwU conlaro rouUiplc qticea. The gratitilartfy of a qfeee 
can he a sized to just as* a few kilobytes of storage. Qiree sti'uctuces can be detimed by an 
appropriate ii !c system adixiinistvator or u:^ witli proper permf.$3ion (0 set Such limits. 

Note that the ahtwe-de&cribed qtrec oiganizatioa isexeci^pkrv and the principles 
kereiii can be applied to a variety of film system organizations including a whole- volume 
approach. A <{txee is a conv^«{it organization accoiding to the jllustrative embodiLnent, 
at ler^st in pan^ because of its available identifier in the inode file. 

Before descriinng fiuriher the pjcocess of deriving changes in two source snapshots. 

imm which data is iransfecred to a deistituition for i«pUcauon of the souive at ttie dcstlna" 

tioQ, general reference is made again to the 61e block structures ^hown in Figs. 5-7. 

Ev«jy data block In a file is itiapped to disk block (or volume Wock). Every disk.'volusiiie 

block is enumerate iuu<piely with a discietc volume block number (VBN). Bfid) file is 

represented by a single inode, ^ich contams pointers to thssc data blocks. Thtsc point- 

co are V3N9" -^ch pointer field in an mode having a VBN in it, \^-hereby a file'? data is 

accessed by loadi^ig up the appropriate disk/vofiuue block with a request lo the file sys' 

teni (or disk control) iayer. When a file's data is altered, a new disk block is aUocated to 

.store the chatiged data. I'ltc VBN of tins disk block is placed ui the pointer field of ^e 

inode. A snapshot captuie^^* the inode at a point in tixne» and all tlie VBN fields i!i it. 
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In order to scale beyocd fiie maxiinum nianbe? of VBN "pointers" ui an inode, 
"iiuiixoa btocks" are used. In esscooe, a disk block is^ aHocateii and billed 'H'ith tlie VBNs 
of the <lftta bJocks, ttie ia&clo poinrers then point to the indirect block. There can exisi 
several levels of indi AXt blocks, which «ui cxeate & lajge tree s^ruct.u^^. Indirect bloclc^ 
are rao^iilied iii ihfi same (nann«r as regular daia bloclc? are — every time a V3N in an in- 
clirect block chai-gest, a new disk/voiumc block is allocated for the altered data of the lad)- 
rect block. 

Fi^;. 8 shows an exemplary pair of s^iapsbo; iuode files wrtbin the soUi'c^ envj- 
ronnscax SOO. In an illustimive cmbodimeot, these repre^senC two snapshoLV inode files: 
the base 1 0 »id incremental 912. Note that th^f^ t-wo snapshots u'ere te^en at two 
points in time; the base represents tl^eciuxent linage of ibe replica^ aad the increjmentai 
represents the linage the replica \vili be updated tt). Hie diCferences between the two 
Jiiiapshols define which change:; are to be derived and committed to the nunotc rep- 
lica/munror. Th& iuode Afle$ may each be loaded into ihe buffer cache of the source file 
server metnoiy irom the on-d!,sk vei'^ions thereof usbg conveiitional disk access prcc> 
eases as directtsd by the storage operetmg system snapshot meager In Fig, 4), In 
one einlx3diinent, the base and laeiemental antipshots are loaded in inci^eins as they nie 
worked on by the operating system (rathei* tl)ai» afl-at-ouce). Each snaptshot inode fjJe 
8] 0» SI 2 is organized iuto a secies of storage hloeks 814. In this illustrative example^ the 
base $aap!^.ot iijode file SlO oontsias storage block^^ denoted by v-olwne (disk) biock 
munb^, 5, 6 and 7> ^iiile the incremental snapshot iuode fih cocrtains execipJaiy stor- 
age blocks bavin? votwne block numbers 3« 5» 6 and 8. Within each of the blocks ai'e 
oi^ized a given aumber of inodes 816. The volume blocks ate indexed ii* the depicted 
order based upon ttietr underlying iogicai tile block pUicemcsit. 

(nthe example of a w^iite-ariywhes-e layout, storage blocks are not inunedi- 
ateJy oven^Titten or reused. Thus changes in a file comprised of a series of volume 
blocks will ai-ways ecsuIi in the presence of a new volatne block number (newly wr^ctcn- 
to) tJiat cap be dett^T^d Uie appropriate logiciil tiie b^ock oHmex rvilative to an o3d block. 
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The existence of a changed voliune block nuntiber a given otFif^t iii die index between 
ihe i>ase soapshor iaode file and incrcmenUiJ snapshot ioode Tik {reneraHy indicates ifaat 
one or tnore of the uiidcrlying iiiod&s and files to whidi tli& inodes poiftt have bee^ 
changed. Noce» bowever« that the system ma>' rely en oilier indicator^ of cluui^es in the 
iiindes or pointers — tl-is niay be destrabie «Aer& a wrltB-in-piace fifc s>'stCin ia kiple- 
nt&Dted. 

A sc&iu)^ if2C^ ssedjcbe? the indej^ for clianged bet^e/ioci'enienta) inc<W file snap* 
shot bbcks» conkpaiing voIuDie blcK;k numbers or anoihcr idestifter. Id the example of - 
Fig. 8. block 4\ath& base siiapsltot ini>d« file ^10 now con^siwnds m the fxlsf scm order 
to block ^ in the i(!Cjr«»net^l snapshot inode file Zt2. This indicates a change oi one or 
moK widerlyipig inoUcs. Jn addition, blodt 7 in tlie b»5(i> snapshot inode tVie appears as 
bloek $ i» the incremental snapshot inode file. Blocks 5 acid 6 are tuidiaiiged in both 
files, add tiius, are quickly scatiued over v^thout ^ltrthe^ orocessbg of a«y inodes or oibcr 
iiilbmuiiioz). Hciice^ scaiuied blocks at the saine index in both snapshots caii be tfTi- 
Cf ^tly bypassed, rednci fine scan time. 

Block pair? (e.g. biock$ 7 aiid 8) that have beeji ideiitified as chaiigcd are for- 
warded (as they ajre detected by the sic&n/sea&ner 820) to iht rest of the source pmcciis, 
which includeii aii biode mdk^ process 830. The tnode picker Ideotifies specific inodes 
(based upon tjtree ID) from the forwairdod blocks thai arc part of the selected qtrcc being 
microtttd. 7n this exaEnpt^tbe qtree ID Q2 is selected, imd inodes GO&taining this value in 
tijeir nie metadata afe "picked" for further processing. Other inodes not pait of the so- 
Jected qtree(s) (e.g. iitodes Mth qtnse IDs Ql and Q3) are discarded or otherv.isc ignored 
by iht jHcker pjcocess $30. Note dtai a niuJtlplicity of qtcee IDs can be sdected, causing 
tlie picker to draw oiti 3 gjtt;up of ioodea-— eacii having one of die selected qiree assxfcja- 
tions. 

The appropriately ''pickod" inodes from chsxtged blocks are then formed into a 
ruimii?g list or queue 840 of changed inodes Z^2. Tl^ese modes are denoted by a disci^te 
tnode number es shown. Hach ii*ode 'm the queue 840 is handed off U) ait inode handler 
or worker Jt50, S32 ajid 8.S4 as a wrker becomes avaiiabie. Tig. 8A is a table 8 J5 de- 
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\m\iiig the bmic ^ of lu]^ Lbe inode picker process 830 uses to detennine whether Co 
$to.d & given i&ode to tht (jtueue for ehe workers to process. 

The inode pidker pix^ce^ 830 queiies whether either (1) the base snapshot' » ver- 
sion of tl)c subject iuode (a given inode number) is aik»cated and in a selected qtree {hox 
S60) or (2) the incremental saftp^sbot's ver&ioxi of the inode is aiiacated tma in a selected 
qtree 862). If neitlier the haxc nor incremeaia! version mi allocated and m the se- 
lected entree then both modes are iguoriid (box 864) and the next pair of izsode vei;^ious are 
queued. 

If the hs^ inodu is tiat in aHocabcd ornot in die selected ([tree, but the incre- 
mental hiode is allocated and in the selecied qtree^ then t)u8 implies at) incremental i|{e 
has been added, and the appropriate inode change is sent to the workers (box S66). 
Similarly, if Uie hase inode is allocated and in the selected qtree, but the incremental 
iiii?de h not allocated of not in the selected qtree, then the thia iiidicatjc^ a hose file has 
been deleted and this is seat on Co the dcstifiation via the data stream forniat (ai; described 
below) (box 868). 

FLiaily, if a base inode and ijicieinental inode art both allocated and liirht sa- 
lected qliee. then the pr\)ces;s qneiies whether the ba^e and incremental inodes rcpredsnt 
tiie same file (box 870). If they /epresent the same file, then fliQ file or its «r»ctatiata (per- 
n^issionSi owner^ peixnissioivs, etc) may have changed. This is denoted by diftexeat gc^i- 
CEation numl>er.'$ on dilTerent ver.'iions of flie iix)de nutnbei' being examined by the picker 
process;. In tius csst, a modified file is 5;ent and the inode worker cotnpftre versions to 
deteiizuxte exact changes as described further belovv- (boK 8?2). If the baj^e and incre- 
meutal are itot the exact sajne frle, then dus implies a deletion of t]ie base file and addi^ 
tion of an incremental file (box &74). Hic addition of the incremental file Is noted as 
si^h by tlie picker in the wanker qilcae. 

Fig. SB is a more deiaii^ view of the infortaation combined in exf^mpJary 
changed blocks (bkxk 10) in the base snapshot 810 and (block 12) in the incrcineiital 
snapshot 2» respectively, Inode 2^00 is unallocated in the base inode fde an^ a^ocated 
in tlie incienicntal inode file. Thi.'^ implies that the file has been added to the file system. 
The inode picker proceas also note-it that this innde is in the proper qtrec Q2 (in this ex- 
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ainple). This mode is se»t to tlie changed i»ode qveue for proccsijing, with a note the 
who!^ tile i$ new. 

fnodc is allocated b both inode files. It is in (lie proper qti«e Q2> »>d (he 
two veti^ions of this jjoode shai^e the same geiierarion nuj^ifcei*. This mc^is that the mode 
reprssente the $anie file in the beisc and the ixicicmcntai snspjihots. It (S lUikno^V!) at diis 
point whether t^e ille data itseif ha? clianged^ so ihc irnxb pkker sends fl)« patr to th& 
changed inode qucue^ aixd a worker oetennistes wliac data \m changed. Inode is 
adncaited in the base iijode file; but not allocated in tlie inctemetkta] ia(vde file. The ba.<e 
vetsion of the inode was iJi the proper qtree Q2, This iv&nm this 'mod& has beeii de!ete<s. 
The inode packer sfizd% this infomialion down to the ^vorke^5 as wei!. Fically^ iiiode 2&03 
is Allocated In U:ie base iuo^e fi^e, aiid r^alhcaicd itt the incremental inode iiic. Tlie 
inode picker S30 can determiite this hecaitr^ the gerKtratioxi notnbei' has chaoged between 
die two veriilons (from H I - iyi). The new file which this ittode re^iresents has been added 
to the qtrse, so iaode 2800, thia is seut to t]ie charsgcd inodc queue for processing, 
with a ttote that the vidiok file Is new, 

A predetermined number of wcrkm operate on the queue 840 at a ^wkxi time. 
In the iUusttattve embodimeat, the wci-ker,s iiinaioQ ii^ parallel on a gniiip of inode$ in 
the queue. That is« the workers procesi> inodes to compieciod id no panicuiar order once 
take%) fjxm the queue iind are fre^ process further iiicdes from the queue as soon as they 
are available^ Otiier j|)roces&eS| such us the sc»i) 820 and picifcr S30 uie also interleaved 
within the ovenall order. 

The fuiiii;tion of the worker is (o determine changes betmen each snapshot*s ver- 
sions of the fik?; and diixsctories. As described above, the scures sna^^shol mirror ai)j|>li- 
catiosi is adapted to analyze two versions of inodes in the cwo snapshots aud compa^ tlie 
pointers in the inodes. If the two versions of ti)e pointer? point to the same btock^ >4it 
know tliat that block hasii't chang«l By extension, if the pointer ro an indirect block has 
not chaoged, then tJtat Indirect block has no chtui»,ed data, so none of poh^ten^ can 
have changed^ «4nd» thus, fione of the dam blocks icndernetttk It in (be tree ^xave changed. 
This means that» in a veiy largo file, which is mostly tmchanged between two snapshots. 
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the process cm »kip ovcr/ovcrlook VBN ^'pointers'' to cacti data biock in (he tree xs> query 
whelher the VBNs of the daia blocks have changed. 

The operation of a vM^ikcr SSO i$ ^lowti by wa^ of exanipte in Fig. 9. Once a 
ch2nge<i inouC pair arc received by the woHcer 850, eacb mode (base and incTem^ntal, 
c«sp«)aivcly) 910 &ad 912 \s scatmed u> dcteimine wheclie? the fiie offset beivveea Ft- 
:^pectrv'e blocks in a match. In this exarjple, blocks 6 and 7 dt> not match. V\q scan then 
co«iliaues<iowj[i the of l>l(«ks 6 amu 7» respectively, flrriving at underlying indirect 
blocks 8/9 (920) &t*M S/1 0 (922). Again the file offset comparison indicates th&l blocks 8 
both arrive ^ & oomrrsoxi block 930 (and thus have not chaoged). Coi^vergely, blocks 9 
iO do not match due to offset difrerences and pouit to cJiatigcd blocks 9A0 find 942, 
Itie chapj^ed block 942 and the metadata above can he singled o«t for transniiiision to the 
replicated SD^ipshot on the des^in&tion (described below; see also Fig. S). The urA in ao 
ilhistraeive eimbodiment extends four levels in depth, but this proceduce oxay be a])pliedto 
any number of levels. In additioo, the tree may In f^t coiitain several changeJ brftnches. 
requiri»g the worker (ift feet, the above-described scanner S20 process) to traverse each 
of the bniiiches ma recttfsive matmer iintil all cha/iges are idejitifcl. Each inode Twoikcr^ 
ihas piovides the chang«!i to thu network for transmission in a maiiner also described bc" 
low. In particular^ new h{ock3 and infbmiiiliou about old. deleted blocks are ssetxt to the 
destinaiiya. Llkjewise, infoijmation about, modified blocks is sent, 

Notably» because nearly every data stmclurc in this example is a file, the abov^ 
described process can be applied not ouiy to file data, but also to dicuctoriC«» access con- 
trol lints (ACLs) soi6 the incKle fd? 

It should be again noted* that the so<irce procedvme can be applied to any level of 
gcanularity office system oi^anization^ including an entire voitune incxle filei By using 
tia inhereia qtree orgaDi^ation a quick and effective way to ieplicate a known si»bsei of 
the volume it? provided. 
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2, Conimmiic at ion BetweeB^ Sourogand Destinatbn 

VViili fiirthcr rcfCTWicc to Fig. 10» tbe trajnstnission of changes frtini flic siiuncc 
sr^pshot to ih? replicaied destioation snap&hct i*<3cscribed in iia overview 1000. A& al- 
ready descfibod^ (he old and »ev/ sruipsheits |»es«!t the inode picker 830 widi changed 
izu5dex cotrtspondiiig to tlic ({tree or otbcr selected »ub<a-gfiiiizat*on oi'tlie subject vol- 
ume. Tfee changed inodes aic placet^ iii tlic qtieuc 840^ aad tiien their respective ttiees arc 
walked Cor chaiiges by a set of uiode worker-'? 850» S52 and )J54. The inode workera each 
send niQssiiges 1002, 1004 and 1006 containing the change iiifotmatlon to » sQuice pipe-^ 
lij)e 1010. Note thnt this pipdiw ouly aXJ example of a \vaty to jmpiemtDi a mechanism 

• 

for packaging file $ystissxi data into a data sUeam and sending (hat stream to a ne^voIic . 
layer, llic message; are routed first to a receiver 1012 that coU«ict$ message and 
sends thein on to an asseinUIer J 014 as a gioup comprising the snapshot chacge informa- 
tion ID be tr&i&mitted over the network 3 IS. As&iii, the *^^etM'Ork'^ as described herein 
should be inke?] br^sJly include anytiiing that facilitates transmission of volume sub- 
ot^azui^ai^on C&.g. qtriee) change data from a source sub-organ(zation to a destination sub- 
organization, even where source ajid destination arc on the aame file server, volume or, 
indeed (in the case of rollback as described ui the above-iiw:orporated U.S. Patent AppU- 
catioik entiiied SYSTEM AND MBTHOD FOR DEMOTE ASYNCHRONOUS 
MIRRORIMO USIKO SNAPi>HOlS) aic the same sub-ocga«iration at<linercnt ponUs in 
titne. An example of a *'net%ork" used as a back to the sssixc voJunie is a Joopback. 
The assembler t014 generates a ^specialized foimat 102O for transmitting the dftta stream 
of information over the. network 3 3 $ that is predictable and understood by the destination. 
The netvsrorker 1 016 takes the aasembled data stream and fonv-ards it to a netMoirkhig 
layer. This format is typicaUy encap<;islated within a reliable networking protn^co? such as 
TCP/IP. Gncapsvlation can b& perforaied by the networking layer, vdiich constnicts, for 
example. TCp/[? packets of the formatted replication dala stream 

Die fojfinat 1020 is described fiuther below. In gcneial, its use is predicated upon 
bavii\g a i^tructnic that supports multiple protocol attributes (e.g. Unix, permissions, NT' 
access cotitrol lists (ACLs), mtiltiple file names, NT streams. Hie tv-pc, filo-create;^.odsfy 
time, etc.)- The fonrmt should aJao identity the data in the sirtam <i.e. the offsei location 
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ill a file of jpecafic cUto or whesber files hac/e 'lujles" m the file offset that shoxsld Feroain 
free). The aaines of fibs should elso be relayed by the foanat More generally* the for- 
mat should al90 be independem of die uadertying network ptotoeol or device (in die case 
of a tape or local dislo'oon-voiatile stomge) prococoi and nie &ysten*i— that is* the iiifor- 
mation is systcen *^Agnostic/* and not boinid to a partieiiiar opefating sysiem sofrvrare, 
thcieb)' allowing soiwce and destiriadon sysifima of diiferejat vcadow to share the infor- 
mation. The fomiat stliould, tbifs» be cornpletely .self-defscnbing requuriog »o infonnasion 
o«L*iide the datfl stream, b this insnner a soxact flic director' of a first type caii be read- 
ily translated into destination file direc(ocy ot a difierent type. It should also allow exteji- 
sibility> in that newer impn>veniont& to Cbe source or destioatioo o|>eratizig system should 
ntyt affect tlie csompatlbility of older versions, tn particular, a data set (e.g. a (lew header) 
thai i$ not nscognlzed by (tie opex atixsg system sbou}J be ignored or dedh wiih in a pr^ 
dictablo mannei" v/itho«t triggering a sys^ini crash or oth^f unwanted system failui-e (i,e. 
the sircam i& backwaids compatible^ This fonnai should also enable transmission oi a 
description of the whole Tile sy.<stem» or a description of only ehanj^ed blodcVi^forn^ation 
widiin any file or directory, lo addftioo, the f(mnat ^hould^encraUy niininiize necvk^o^k 
actd prooeaNor oved^ead^ 

As changed information Is fbnvarded cv«r die network, it i$ received at the desti- 
natitm pi]x;li!ie piece 1030. Tiiii; pipeline also kcivdes a net^'oiker 1 032 to zead out 
TCP/IP packefla trotn the network i^io the snapshot replication data stream ionxtat 1020 
cncapsuUted in TCMP. A data reade* aiid header strippfir 1034 recogEiizes and rc&pojids 
to the inctHnii^ fucniat 1020 by acting apon infbrmaiiou contained in various foimat 
headers (described below), A file writer 1036 is responsible foi placing file data derived 
from the format into appropriate locations on the de^tEnaxion Hie system. 

llu! fj^stinaifon pipeline 3 030 forwards dasa and dii^oiy infonnatio!! to the inaki 
destination snapshot mirroj* process } 04{), vAtkth is desciibed in detail below. The <ies»i- 
nation snapshot mirror pi^ess 2040 consists of a dirsctor>' stage 1042, «hieh boilds the 
new replicated file system directory h^erarchy on the dcstinattjoii side based upoo the re- 
ceived snapshot changes. To briefly summarize, the director)' stage creates^ removes and 
moves iiSes based upon the received formatted infoctnation, A map of inodes from the 
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d-estisutioR to the source is gcn^ated aiid updated, lu this nianriCr* iaode tiusi^^s on the 
jjource fife syatcai are associated wi^ii correspoiidiog (but typicaily <^ilTerecit) iixxJc nmn. 
b(sis oa the destitis^fon file systet^j. Notabi>\ a temporary or **purgaU)ry** directoi> 1030 
(described in further detail belowj is estaWished lo retjiin any modified or deleted direc- 
iory entries J 052 until tiiese enuies ere reused by or iieinoved iVom the replicated snap- 
shot at the n|>propTiate directory rebuilding tst^ge v/Uhiis die direetcny stage. lu addition^ a 
ttlc sta^e H>44 of the dcsiinatioii mictoi- ptocess pojpulAtes the e^tftblislied fiies izi the di- 
rectory stE^e with data based upon iDformatioa stripped from ass;)cisced fonrtat headers. 

The format into which source snapi^faot chiufiges are ocgjaxuzed is ihown schentflsi- 
ci^Iiy in Fi^. \ \ aiid 12. In the illustrative euibodiuieiit, the fDnuat i$ organized siroiind 4 
KB blockfL The header &i2e and anrangementt can be v^dely varied in aifcmate embodi- 
mMits, however. There- arc 4 KB lieadcis (11 00 in Fig. 1 1) tiiat are ideiriified by certain 
"header types." Basic d^-ita st;;eam headei's C*<Jata'') are provided for at most ev'ery 2 
megabytes (2 MB) of changed data. With ieferenoe to Tig. 1 1 » the 4 KB standalone 
header incUides three pails, a I KB generic pia^t 1 102, a 2 KB nou-generic part 1 ] 04» and 
an 1 KB expaasioo part Tlie expansion pa«t \$ not \tsed> but Is available for later ver- 

The ga^eiic pan 1 102 ooiitaios an identifier of header type 1 1 10. Standalone 
tieader types (i.e, headend not ficillowed by associated daia) caii indicate a start of the daUi 
stream; an end of part oiie of the data stream; an end of the data stream; a list of deieted 
files encapsulated in the header; or ti»e relatittoship of auy NT sireamdirs. Later versions 
of Windows allow for multiple NT "irtrcams" r^ated to particular fileiuunes. A dis- 
cussion of streams is found in O.S, Patent .Apphcatiou Sedal No. 0^^891,195, cnutled 
SYSTEM AND METHOD FOft REPRESENTING NAMED DATA SHIEAMS 
WITHIN AN ON-DISK STRUCTURH OF A FILE SYSTEM, by Kayuri Patei. it al, the 
tieadbings of which are expressly incorporated iieteio by reference. A^iiiO in the generic 
part 11 02 is a checfcsiim 1112 thai ensures the he»3er is not Of>mipted, tn addition other 
data such a;i a ^'cbeckpoiut" 1114 used by die source and destination to track the progrest; 
of replication is provided. By providiiig a list of header typss, the destinaUon can more 
easily operate in a backwaidsrcompatible mode — that is, a header type ilial is not teoog- 
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nized by tlas. destiiuition (pnividsd from a ww^t version of the sourra) can be more easily 
igDored^ white n>CDgni2e>d headers within the Hmics oftlie (tesiina»oo versio!! prcc- 
esKed ais usual. 

Hie kind of data in the non-gcacric part 1 104 of the headei* 1 1 0«!> depeods m the 
header type. It could inckcte iofonnation lelating to (ite offsets (1 120) ix) the case of the 
Ua»ic beadejv used for tbilow^gt! data traasmission, deleted 6Ee9 lln a Ktedd^otie he^er 
listiiig of such files that are no (onger in une on ilw soiiict or whose gejieratioii m-mber 
has cbsngcd) (1 122), or otlier header-specific iixfonnatiori (1 1 24 to be diacribed below). 
Agaiii, die various stand^iloue headers stc hiterposed within the daf a suisan format ai an 
appropriate location. Eaoii header is mmg^ to either refmrtcc an itickded data set 
(sitch as deleted Kilesv) or foiiow-on infoinsation C^hast Ci\c dsta). 

Fig. 12 describes Che foonefi )0^0 ot'thu illustrative re|>licattondata scream in 
Cbrther detail. The tomi&i of the replicated data stream i$ headed by a staiidaione data 
stseam header 1 202 of the type "start of data stpeani." This header contfiins data in the 
noH-gciicric part 1 \ 04 generaeetl by tjic somce dcscribi*i£ flie i^ttributes of the <ia!a 
stream. 

Noxt a series of header? and follow-on data in the {o<inat 1020 define various 
*'part I'' iii&iitiation (12Q4-), Significantly, each diiectory da?a set being trajisniitted is 
preceded by a basic header with no tton-^enedc data. OiiJy distctoiies that have been 
modified are transmitted, and they aoed not arrive In a particular order, Note al-sio tiuit the 
data froin any paxtivular directory need not be catu'tg\i0i28. SacU directory entry is loaded 
into a 4 KB block. Any ovedlow is ioaded itto a new A KQ block. Eadi directory entry 
is a header ibilo wed by one or more oaines. The eittry deiwribcs an inode a.Qd the direc- 
xoiy names to follow. NT stream directories aic also itansmivtod. 

llie part 1 foiinat infbmiatiim 1^04 also provides ACi. infomialioi* for every file 
that has an associated ACL. By transtnitting the ACLs before their associated file data, 
Che destination cm set ACLs befOi« file data is written. ACU; are transmitted io a "regu- 
lar" nie format. Ddeted file iDformaiiofl (described above) b scjit with such itifontiation 
included in the non -generic part 1 104 of one or more standalone headers (if any). By 
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sending this information in advance, tli^^ directOTV tree buildesr can difFerenriatc batvnsen 
moves (uid delete^^. 

The part 1 tormat iiifonnation i 204 alsc cmics OT stieam diiccloiy (strcanidir) 
reUitiooship information. Onst or mot?, standalone hesdcss (if sny ) notifies Che destination 
flic server of every clisnged file ct dinsclory ihar impHcatesNT streams, regardless of 
whepier the sfreaitiji h&ve ch^ged. This information is included in tfie aon-geneHc pan 
1 1 04 of the header 1 1 00 (Fig. ) 1 >. 

Finally, tlie part I fona&i infomiacion 1204 iududCH special files for evei> ciiangc 
in a &>'tnti;]k> natned pi{)e> socket, block device, or character device in tlie replieated data. 
vneam. lliese files are sent fii«, beeaxise they needed to assist the desibttion in 
building tl>e inirastiiictiire for creation of die fepliciited file system befoie it is popuUted 
wilh fiie datta. Special files aie, like ACLs, transnsitted in this formal of regular iiles. 

Olioc \%ari»u9 part I infotmaiion 1204 is traasraitled, the format wDs lo: an **end 
of p^ 1 of the data stream* header 1206. This ii» a b$i$ic header imviiig no data in the 
non-generic part 1 104, This header telis the destination tii^t part 1 is complete and to 
aow exp&ct file data. 

After the pari I jnfonttation, the format presents the Tile aiuJ stream data I20S. A 
basic hcatler 2210 for every 2 MB or Jcsb of changed data in a fiJe is provided, fot lowed 
by the file deta 1212 itjtdi. The fUes camprishii! the data need iiot tie writceti in a pai- 
tiailar ordcj; aor must the data be contiguous. In addition, referring to the lieadei- in Pig. 
1 1 , the ba^ic header includes a block muisbeis data stmcftiiie 1 130, associated v/itb thi 
non-genetic part 1 104 vs'orksi in conjunction with the '*boles array'' 1 1 32 witltiu {in this 
example) ihe f.eneric pait 1 102. The hoJes array deiiotejj empty space. This striicture, in 
essence* psvvide^ tlie mapping xrom the holes aitay to corTcspondiug blocks in tlie die. 
This stiucture instnicts the destinasion w*eic to write data blocks or holes. 

In general files (12 12) arc wrinen in 4 KB chunks with basic headers at every S12 
chuoks (2 MB), at most. Likewise, fitieatns (a(so 1212) are transmitted like regular files 
in 4 KB cbuitks with at most 2 NiB between headers. 
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PmaUy,Lheendofthe r€pikat«d<iaUStrean^ fomaai 1020 is marked by a tboter 
1220 coiiMsiiDg of sfaiKialone header of Uic t> pe "cad of data stream.'* This iwadtr has 
no specific <iat& in its non-generic psr( 1 104 (Fig. ( 1 ). 

When the reunot« desiinariou (e-g. a remote file server, remote volume, remote 
qtree or the same utre&) itccivcs ibe fonriatled data stream fiom th« source file server via 
the netv/ork, ii cr^vsa ^ new- qtitc or modifies an existing jnirrored qtree (or another ap- 
propriate organizational ssnictiu'e) and Ms it vidfh ckfei. Pig. 13 shows the destisadon 
snapshot iniiror proccsjs 1040 giotiier deimt As discussed hntfly abovc^ the process 
oonai$ts of two inaic parts^ q dhopiory mg^ 1042 and a data or ftk stage 1044, 

The directory stage 1 042 ia invoked first duHiig a transmission the data stream 
from tbe soiirce. It consists of seveial dijtinct p«its. Tliej?6 parts are desigiiod to hamdie 
all port 1 fo7n)^(nori-fiie)data. In a» illustrative embodimenit the data of pSAl 1 is read 
into the deatfioatioo> stored as files locaiJy, and then pro<:essed from local storage. How- 
ever, the data rviay altenaatively be pr<x:essed as it arnves i».reaUijQac. 

More paiticuiarly, tilieiitst pari of the dtitctory stage involves the process- 
it\^ of deteied file headers (1310), Eittries In the mode map (described further below) ait 
erased with respect to deleted fUes» thereby severing a retatioD ber^een xoappsd modes 
on the replicated destination snapshot aod the source sitapshot. 

Next the directory stage lusdcttakes a nice cleannig process (1312). This step rc- 
inov{:s all dircetoty entries fonn the replicated scapsiwt directory L330 i\iat have been 
changed on the soiiree fasapshot. The data sti«am fonaat (1020) ifwJicatiBs whelhcradi- 
njctoiy eiitiy has been added or rtniovfid. la iact, di«jctOJy entries from the base version 
of the disecucMy and direccoiy entries .&om the incremental version of (he directory are 
both prtscat in Che foiiuat. Tht tiestinaiion snapshot mirror application converts tlie for- 
matted data stream into a destination directory format in which each eutiy tjiat includes 
aji hiode nURiber> a Miit of relative names (e.g, various mulli-prutoco) nasties) and a '^cre- 
ate" or "delete" value, hi geoeral each file also has associaied therewith a gcni;ra*ton 
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number. 'J'he iiiode numljer and the gencr&tiou nambsr to$€tJhi«r form a O^e used to di- 
r£ct!y access a iile v»ittiiD the file sysiem (on both tlie iwiuce and the (le^iinstion). Ihe 
source sends this tuple infunnatian io the de^nation within (he fonnat and tiie aj;>propri- 
ate tuple is stored on the destinatioii system. Generation numbers that are out ofdate 
witli respect to exiating destinatioi> iiles indicate that the file has been deleted on the 
aource. The use of generation slumbers is desciibed fiiitb^ below, 

I'he destinaeion |wrf>ces$e5; base directory entries as reinovais aiid iiicreinejital di- 
zeciory CDfries additions. A iiie which has been moved or lenaraed is processed as a 
delete (fi'oni the old dircUery or tcom ihc old nameX then as aii add (to the xvsvc diieetciry 
oc with a new name). Any directory eutries 10S2 thas are deleted » or otherwise ixiodLtisd^ 
are movied tesnporarily to the temporai>' or *^urgfttary*- directory, and te^ not acoessibie 
In thi» tocation by The puF^atoo directory allows modified entrie$ to be, in eS' 
sence» **inoved to the side*^ rather than co;npletdy jrenx>ved as the active file system's di- 
iwtoiy wee is worked on. The purgatoiy directory e<itries^ them wives point to data, and 
Oius ptwent the data hom beoomiag deJeted or losing a link to a directory alto^etlier. 

On a base transfer of a qtree to the destination, the directory stage n«e building 
process is implemented as a breadth-first tfAversa! of ai! »he files 2<nd directories in the 
data stream, staiting with the root of the qtree. The directoiy stage theu undeitakes the 
^ee building process, which builds up all the directories with stab encdes for the files. 
Howe\'er, the depicted uicremcntaJ dl'wtoiy stage C104Z), as lypioiliy described herein, 
dit&ts from a base tronsf^ in that ihe tree building process ( 13 J4) be^ns with a direC" 
foiy queue that includes id! modified diTxsetories currently existing on both die %\>\ivc^ and 
the destination (le, the modified directories that ex-t$tcd prior to the transfer), list incit* 
xnental directory stage tree btuMing process then processes the reinaiDder of tlie dinscu)- 
lies according to the above-referenced breadth-fuist approach. 

For efOciency, the ^urcc side depends t^n suode numbcrt^ and directory blocks 
rather Xhdsi pathnames. In general, a file in the repHcatcd Jinsctory tree (a <jtreie in this 
example) on llie dcsthiation cannot expect to txrceive the sa^ne inode niimber as the corre- 
spoiid-ing file has used on the source (although it is possible). A^^ sach» an inode map is 
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cstablisiied i» to desiination, Tian map U00» ^howo generally in Fig. 14, enables the 
dOUTve to relate each file on the source to the destinattoji. The lUdppnog t.^ based generally 
upon file oifsets. For example a received soiurce block having ""offset 20KB in mode 

snaps to the Mock at ofifect 20 KB iti replica-ed oestijiation inode 9912. The block 
can then be written to the appropriate oi!^et in tticdcstiaadon file. 

More specifically, each entry in »lxc itiode map 14G0 contains an entry for each 
inode on the soarce ^rispshoi. Bticb inodc enCiv 1402 iii the map is indexed »ud accessed 
via the 9ow«e inode tuusiber (1404). Tlie$e source inoties att listed in the map ir. a 
quentlal and ntonotcmicaily a.*K»iidiiig order, notwithstiuidlng tlie order of t}ie trapped 
de^tioftuon inodes. Ui>der eacli source iuode number (1404). the map includes: the 
M)iuce genecatjon number (1 406) to verify that the mapped inode matches tlie ovur^Vi. file 
on the souroe; thcdesiiiiation iiiode numbtf (140S); aad de$ttttahon gcnei^ion nunifcer 
(1410). As no^ above the mode nusiher and geiieratfou number tog^?er compdse a 
tuple needed to dii^'y aicccss an associ&tod file in the eoriesponding f\ic system. 

By maintaioina the sohtcc generation number, thedesiiiiatioa cau <letcnninc if a 
a\fiha& been modified or deleted on tl^e isourcc (and its source associated inode reailo* 
cated), ji5 the source gcsieration msniber is incremented upwardly vritfc respect to the 
stored destination. When the source uotifjes the des^tination that an inode has been modi- 
fied, it i»tids the tuple to tlie destination. Tliis tiiple uniquely Identifies the inode on the 
souroe system. Each time the souyce ludicjrtes tliat an entirely new file or directory has to 
be created (e,^. *^create*'> the destination Hie systiein creates that When the tile is ore- 
ate^d. tlie destination registers data as a new entry in its iuode map 1400. Each t'Eine the 
source iTKlicates that an exi^ng it ie or din^toi)' needs to be deleted, Ute deshnation 
obliterates that file, ajnd thai dears flte entry in the inode map. Notably, when a file Is 
modified^ the souroe only sends the tuple aiid the dat:gt to be applied. The de.v(inatioiu loads 
the source models ent^ from tht inode map. Ufht source generation number matches, 
then it knows that the file alj^.y ejcist;* on the destination and needs to be moditled. The 
destinauon uses the tuple recorded in the inode map to load the destination inode. Fi* 
Dally, it caii apply she file modifjcatioiui by using the inode, 
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As pan ofthe tree building process reused entries' are "moved" back from *e 
pargacory directoiy to the replicated upshot din!cto?> 1330. Izadifionally, amovsof a 
file require!! knowledge of the name of the moved file and the name of the file it is being 
moved to. The origind suune of the moved fik inay ool tst^tUy available in Hht puj^a^ 
toxy directoiy . In additiom a full move would rcqtiire t>vo directories (purgatot^- and lep- 
lii;ated snapshot) Co be ziiodilied impUcating additional ovei'hcad. 

However, in the illuHtiattve embodiment, if the source inode^ iccei\ed at the des- 
tination refer to iuodes in the iiiode raap 1 cbco the directoxy stage creates (on the 
curjKnt bi>iJl-up snapshot director)' 1330) 3 file entry having the desii-ed file risme. This 
oainc can be exactly (he came dedved liom the source. A hard link 1332 (i.e, a linix-* 
based lifik eitabloii tnultiple nasties to be assigned Ko a di^rete file) is creafed between 
that file on the sniipsbot (iitectoiy 1 330 and the enCiy Iti the pw^atory dii^ctoiy. By so 
fidcing the entiy , It is now pointed to by both the purgatory dizectory c^d the file on the 
snapshot directory itself. When the purgatory directory root is eventually deleted 
(thereby kilting off pitrgatory) at the eiid of the data stream transfer, the hard link vviM 
remain to the entry, en3uri«g that tl^e specific entry in the pu^^'.atory directory wiil no? be 
deleted or recycled (givca dial the enuy \s hiik co(uit is stiil greater than zero) and a path 
to the data irdui the flic on the new ditif ctofy is maintained. Every piugatoiy eniiy tliat 
eventually becomc$ associated with a ftle in the ogwly buiJt tree will be similarly bard 
lilted, and thereby survive deletion of the purgatory directory, ConveTue))^ pingatory 
entne$that are not relinked vAU not survive^ and aie ^ectively deleted peimancntly 
v^hen ptugatox>' is deleted- 

It shmijtd nov/ be clear that the use of tnappin^ and generation niimber tuple? 
avoids the expensive (IBroro a prooessi^jg staiidpoint) u^e of convcntionaj full f}\t patli- 
names (Or relative pathnames) la the daia stream the source* Files tjiat sre modified 
on the source cat) be updated on the destination v/ithouf loading a directoiy on either the 
s[>uicc or destiuatiojii. This limits the information needed from the source aud the amount 
of processing reqttired. U\ iidditioxi) tlie ^source need not maintaiti a log of directory op- 
eration;;. Likjcwise, since the Oestinaiioi) need not -namtaiii a centisl repository of the 
cunenl fUe system state, multiple subdirectcties can be cH>erated upon cxnicurreutly. Fi- 
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naMy, neither the source, iior the deKtinAtlo» must explicsUy trAck delettd files 6& &ucli 
dcieteJ iiiss arc autanialicaU> removed. Ratlier» flie source only seiids im list of deleted 
fibs at»i the destinanoi] u^es this lisi to conform the inode map. A$ »uch. tl)cie no need 
to aelecJivclv travcfse a tree more than oiice to delete iilcs. and at the conclirsioa of the 
tnm9f«r» simply eliminating the purgatory directory rs the only speciHc Ole ckaning step. 

The ditiectoi^ stage 1042 sexs up any ACLs on directories as the direc^orres are 
pfoc«ss«;l during ivee building (salstep 1316), As dcsctibed above, flic ACL ^ NT 
suteni retationsbips to files az6 coiiiaiiaed in Appropriate stAodalone (leaders. ACLs Ai t 
thej) set on fil«s duvmg tbe b^Iow-de-jcribed tile s^tagc. NT st^afims aic created on files as 
the fiit^s are^ themselves, created. Since tai NT steam t&» in fact, a directoty. the eaittncs 
for It are processed as paxt of the dSrectoiy phase. 

I ht licw directory tree niay contain files with no data oi old data. When die "end 
of part r' fosfinat headw ia rwid, the destiiiatioti mirror process \0A0 enters the file stage 
lti44 fn Which snapshot data tiles 1340 referenced by ttie (lireccoxy tree are populated 
with deta (e.g. change data). Fig. ) 5 sho\v& a simplified procedure 1 500 for v^Ttting fib 
data 1502 received from the soi^rce. In general, each (up to) 2 MB of data in 4 KB blocks 
arrives wiih coritsponcfiiig source irjode nujnbers. Tlie iaode map KOO is consulted for 
conesponding eiitries 1402, >^p£opnate offs^^ts 1 504 a^e derived ixit the data« asid it is 
wTftteiL into predeteimioed eniptv' desfinaHon snapfthot data flies 1340, 

At the end of both tbe ditectory stjige 1042 aad data stage 1044, x^tot all direc- 
tofy and fUe data have been processed^ and thje data !;tj-eacn transfer horn llie aotttte is 
co!nplete» the aew replicated snqjsjhot h exposed atonucaUy to the osei'. At thiij tinws the 
amteiits of die purgatory directory 1050 (which iiiclnded aity entries chat have not be 
**moved" back into the rebuilt tnie) is deleted, 

a should be noted that the initial creation (the "Jevel zero" tiansfer) of the iepli- 
cated snapshot oa the destination follov^-s the s^enera) procedures discussed above. The 
differenco between a level zeix> transfer and a regular update is that there i» no ba$e snap- 
sliot; so the comparisons always proces^s infomiation in the iiicrementaj ,stiap£hot as addi" 
tions and creates rather than modifications. The destination tniitor application starts tree 
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building by proc5:$sing eny dinecioiics already knov/n to it. Thft mtlsA directory estab- 
lisKcd in ihc destmaiion i:^ simply tlie iw>r directoiy of ih^ itplicACod snapshot (the qirce 
rooO- A ciescmaciion root exists on the inode luap. The sowoe eventii&li)' irfuisinitfi a root 
(other fils9 received may be boiled until tiie rootxurive.'^), and th^ root is f:aa|>ped to Che 
exbci Ag destioation root. Fii«s I'eferenced in the root are then nridpped in turn in a ^'cre- 
ate" process as they are received and read by the desiinatjon. £ventuaJiy» the <jnt!re di- 
rectory is created^ and xhcD the daUt files ai<e populated. After tlti^ a rei^iica file system Is 
coaipii^te. 

described y^v^ a source and destlDaCLO]) am be the $ame qtree, typically at 
di.1lereDt poipis in time. In this caxcs, it is contempiated that an incremental change to a 
itnspshot can be andofte by applyiti^ a '^roitback'' procedure. ]n essence, the base and iu* 
cremeutsl snapshot update process described above with reference to Fig. % is perfmned 
in reverse so to rewvei" fxocn a di«£stci-, and reiuni the active file system to tlie state of 
a givcii snapshot. 

RefcrcTice 1$ made to Fig. 16. which describes a geneivilized rollback procedure 
1 600 accojxiing to aii ilhistrative embodime»t. As a matter of ongoLig operation, in step 
L605» a 'Tifst'* scvipslwt is created. This firsi snap^t may be an exported soapetbot of 
the replicated upshot on the destination. In the interim^ the subject desitinmion active 
Jile sysiexo (implicated ^n^shot) is modified by an incrcm«ntaJ update from the source 
(atepl6i0). 

in response to ai*. exigency, such as a }>amc, ct«sh> lai Jure of the update to ooro- 
plece or a userHnitiaiod command, a rollback iniUation occurs (step 1615). This is a con- 
dition in whicl) the next titcremental update of the ce})]icated snapshot will not oocnr 
properly, or c)th«r.vise does not reflect an accurate picture of the data. 

in response to roilb^^ck initiation^ further niodificationAipd?4e to tl« leplicatcd 
snapshot §8 bolced or ^zsn (&tcp 1620). Tl)is avoids fint^ter modifications: that may 
cause the active file system to diverge from the stati; to be reflected in a second snapshot 
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* 

that will be creiii^d from the Active fiic system in the mext step (t:iep ) 625 U^low) uxime- 
dialdy aflcr Hit haJL McNiiiicatiloo to the active til« sysfc&m h^ted uKing a vfiriety of 
techniques such as applying read only staiiu uv the file systnn or denying alS acxx»s. In 
one emtiodinient, accesi^ to ihe active file system <s rodirerted to ati erxported snapshot by 
introduciiig; a level oi'indireQtion to the inode lookup of the active file system, as set fonh 
i)^ tl)e abov&'incorporaled U.S. Patent Application entitled SYSTEM AND ME'ITiOD 
FOR REDISECHNG ACCIESS TO A REMOTE MlRRORiivD SNAPSHOT, 

Aitex the halt» a **9ecoad^* exported Snapshot of ihe modified active file system In 
its most wjiTesii stale is iiow created (jtep 1 625), 

Next, in step 1^30, (he mcrementa] changes axe comput^Kl between the M'^ndand 
the first snapshots. This occurs acoordance with the procedure deseribeii above with 
leibrence to Figs, $ md 9^ biit ii^ng the sccojkI sii^p^sliot as il)e base and the first snapshot 
as the incrementaL Thea>nipoted inereinental changes are then applied to the active j)le 
system (now frozen in its present state) In »tep 1 635. The cbanges aie applied so th&c the 
active file system is eventually '^roUftd hade" lo die stare contained in the fi^si 3«apshot 
(step 1640). Thi&' is the active fde system state existing before the exigency that necessi- 
tated the rollback. 

In cenain siUiations« the halt or freeze on. funber modigcatioo of the active file 
sysfcQi aocoiding to step \625 is released, allooving tlie active file system to i^ain be ao- 
cessjcd tor modificajtion <«• user i^itervenrtioji (step 1645). However, in the case of certain 
processes, such as rollback (described beiow)» a roUed baoic qtree is inaintaiiicd tuider 
control for fuither modificntions by the iieplication process. 

One noted advantage to tiie foilbsck according to this embodiment is tJiat U er*' 
ables the undoing of set of changes to a ftplicated d^ita set V'ithout the nted to maintain 
separate logs or consuming significfuit system resources. Farther the directioa of roll- 
back— past-to-prcscnl or preseoHo-pftst--« largely ifrelcvant. f urdierraore, asei oi the 
piugatory <lu^tory, aiid iiot deleting Gles, enables the rollback to not ^fftKft existing NFS 
clients. Each S client accesses files by means of fi^e handles^ containing the inodc 
ttomber and generaticm of the file. Ifa system deletes and recreates a .ti!e» the tiie '.^N 
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hdvt a dUfercnt UM)de/g€!neratk>iiiuple. As such» the NFS client wiQ no» be able to ftcct^sii 
the file without r&ioading if. {it will see a ?DeS5age aboui a stal^ Hie handle). The pmrgiii- 
tory dirM}U)ry, ho«vever. ^\ows h delay in unlinking GJes (intil the ctut of die transfer. As 
such, & rollback as described Above am resurroct flies ihsx have just beea moved inio 
picgaioiyt withom die Nf^J clieats: taking police. 

WTiere a desciiiartion repliealed snapsk^t may be needed al the source to, f«r ex- 
ampi^t nsbuitd the source qtrcc snapshot^ (in other woi d^, the role of the souroe aad deati- 
iiAtiOn faii^i^iot a^e reversed) the is9c of generalized rollback i^uim that (he inode map 
be properly related betv^cen aoixrce and destination. This is because t2ie soiKK>e inodes do 
not znatcln the destination inodes in lii&ii respective tiee$. For the stuue leodon m. mode 
maj) 15 used to constrifCt the destii^ation tree, the source must cxpitjit a majjping to deter* 
(Dine tl]ee nature of any inodes recurtied frotn the destinatioii (iuriiig t]ic roUbaek. How- 
ever, the inode taap lesidicg on the destination diits noi ejSictently icdex The infoanallon' 
in a form couvenient foe u^e by the source. Ratlier, the source would need to hunt ran^ 
domJy through the Oider presenied in the map to obtain sq)propriate values. 

0(ie '^vay to provide a ^urce-eentric inods niap i$ to perfono a **f^ip*' oixnap en- 
tries. Fig. 17 deoails a procedure 1.700 tor performing thr ftip. Tlic flip operation is initi- 
aled (5tep 1 705) as part of a rollback initiErted as part of e disaster xecovesy procedure of 
for other reasons (s^rtomatically or under user direction). Next, the destitiation and 
source negotiate to ticussfer the inode loaap file to the source from the destinatioii. The 
negotiation can be accomplished xzenng known data transfer methodologies aj kI include 
appropriate error correction iuid ackaowledgemeiitH (step 1710). The mode is thereby 
transfen ed to the source mm the dcstinaiioa and Is stored. 

Next the souive (-Ahich after the negotiation becomes the new destii^ationX <^ie«te» 
an empty tt:ode rnap file with one er».try for etich inode in the sovsct qttee (step 1 71 5). 
The iKtWr- destination then initializes a counter >^iih (in this example) N-l (^tep 1720). N 
in tlic variable representing the inode count on (lie uew destination qtree. 
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lit step 1 725^ the new destination lcok:» up tht Nth xrlc^de frctn the eiitTies associ- 
ated vvitb tbc old destination in the stored inodc ruap fiie (i-e. the jnap from the old <ie$ti' 
oattoDniew .source). Next, the new destinatiou dtnemiines if siwh an entry cxisR (deci- 
sioii step 1 730). If iio entry exifvto. tlieri a zero entry m created ift the new ioode xTiap file» 
representing tli&l the Ntl) inodo of the new sororce (&id destination) is not allocated. How- 
evetT; if there exists m NtJi inode of the new aource/otd destituitiotk, then the decision 5tep 
1730 blanches to step 1740» and creates a new entry in the new inode rnap file (created in 
$ccp 171 5). The new e»»r>' maps jisw source (o!d destination) Nth tnode to the pioper 
new dcstsnatioii (old source) inode. Note, in an ailemate embodini<5ni» the new tsiode 
nsap is provided witli a fvll of zero entries before Che mapping begins, and the c>nea- 
ti&n of a "23ero entry,** in this case ^ould be taken broadly to include leaving a precxiat- 
rag zero entry in piacc in tbe inode map. 

The procedure 1 700 titen cheeks if N equals the number of i nodes io the o{d des* 
tina-ion file system (decinion step I74S). If so, the new mode map iih is complete and 
the procedure quit$ {siap L750). Conversely, ifadditional inodes are stili to-bo-mapped, 
then the counter is Incremented by one (N^N+I in stq? 1 755). Similarly, if a zero entry 
is made into tha new inode map^ then the pi'ocedore 1 700 al90 branches to deci<iion step 
) 745 to either increment tlie counter (step 1 755) or quit (step 1 750). Where the co^inter 
\s incixsmented in step 1 755, tb^? pix?cedure brandies back to step 1 725 wherein tbe in- 
cremented Nth inode is looked up. 

By %vay of example, Fig. 18 shows an illvstrative old destination inode map file 
ISQO inckfding three exemplar^' enoies 1802. 1^04 aiid 1806, sequentially. The fields 
1404, 2406 (source aod destinatJon inode niunbers), 1408, \4i0 (source and destination 
geneiasion n^miben) are desc^bed above wi^ reference to Fig- (4- Entry 1S92 tihov/s 
that (old) wurce inode 72 maps to (oSd) destination iiiode 605. LLkewise entry 1S04 
maps so^irce iiiode 83 to destination Inode and emiy 1 SO^ m»ps source ino<le ] 90 to 
desttnatiot) inode 150. 

p!^ 19 shows an exen^plasy new inode map flic 1900 gene-aied from the old inode 
inap file It^OO of Pig. 1^ in aiccordance vvith the flip procedofe 1700. The new map in- 
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eludes fields for (iiie new source (oid dcstinadoii) mode 1902, new desiiivttici) (old 
source) inode 19CM^, new somoe (oid destination) ^enemtion number 1906 and new desti- 
nation (old iioarce) generation number 1908. As a result of die ilip, the entry 19!0 for 
new source mode 130 is presetted iii oppropnace in<^\ otdei' snd is paired mv/ de;?- 
tuiatioD inodc 190 (and as»Ov«ited geiieiaifon nwnbers). T he eato' I f>12 foi- new source 
iijode 328 isi next (after a setiefi of coiisocutiNt, interveiiiag eatries 19J4 for acw somce 
iiKides \SU2'^2) md fxiapc iiew desittDatioa inode 83. Likewise the entry 1 916 for new 
source iiiode ^5 mAns new destination inode 72, after intervening entries 19 IS for new 
sooroe inodes 329-^4. The intervenizig source incudes inay conuiin mappiiot^ to other 
new existiiig destiiusktioti modes, or the)' may bacve & zero value a^ fibowxi iii entry 1930 
fc»r ricw soxirce inode 606 (as provided by step 1733 of the proeedui^ 1700 wl^rc no new 
destination inode was detected on the $toied old sinirce inode map (li!O0)}. 

G. ^ nodc Map Assoc i atioa 

K is finther contOEnpisted (hat» two replica/minror 5n«)riiot!> of the aame source 
can e&tabHsli a mimvr relationship widi one another. These two snapshots may be r^ie- ' 
scniative of two different points lit tiine with respect to (he original source. Fig- 20 ^hows 
a generalized aiviiown^jQt 200O in which an original sowrce 2001 has generated two r«5jp- 
licarmioor Siiapshotj^ DestinaHon Snapshot A (2002) and Destination Snapshot E (2004). 
Ewsh DcAtiiiatlon Snapshot A md B (2002 and 2004) has m associated inode map A and 
B (2012 aiad 201 4» lespectively), used to map tJie inodes of nransfeered data stream from 
the original s<»uve200i. 

In the iJlustrated example, tlie Destination Snapshot A (2002) is now prepared ♦<> 
transft^- clianges so as to establish a mirror in Destination Snapshot B (2004). However, 
the reverse is also ccmtenipEated, i^. Destination Snnn^hot B establishing aMirrc^ in 
Destination Snapisbot A. Thos> Destination Snapshot A (2002) becomeii the new 
"source'' in Che tFan»fei' with Destinatton Snapshot B (2004) acting as the desired defitina- 
tioa syj^tem for replication data from Destination vSnapshot A- As in the alxjvc-descfibed 
flip enibcKitment; the new source 2002 transfers its inode map A 2012 to the destination 
system 2004. '^The destination system 2004 then determines the relationship l>etween the 
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two jtystetn's tnodss. In this case, both the new source end i\)t ntw dcstmation system 
have tbeb: own inode maps A flnd B (2012 and 2014), indexed off Cho old source 2001. 
and reierencing the raodes in their respective txoes. Giveip the existence of Iwo rsspectiv'^ 
iDode ixiap$. m ^'associative" process 20\(> ^^nlks the tnode maps concuiT£iit]y» inodc-by- 
ittode. For each incxie fn>m Qie ongtnal soui'ce 2001, Che pirooess extracts the ^'d«st»iaiioji 
iDode.'generatlon niimber" from euoh of the inode maps A uid B. It thcsn treats the new 
source as the ^pproi>r'ate map 'm<kx. for the ntw associated inode map 201 8. In the asso- 
cxAVbd lA^y^ it i^toi'es the new source generation nunnber for the new source indent iziode 
nofnt^er, v.-itii each index ^try also as^wciated witii^mappcd to the new des^lnauom 
ioode/geiie;atioA uuxnber extract from the Lnode nuip B (2014). lite new map is uaed 
by the new dcsibation 2004 in accordance with the pr indpiefi Jescrib^ above to build 
trees in the directoty based upc)n changes in Xht ncsv soi^rce nith respect to various points 
ill time. 

By way of example, an hypotheiJcai old source OS inode iwimber 55 (OS 55) is 
niappcd to olddestmatioa snapshot A in its /nap A to old destiuatiou A iuode 87 (A 87) 
and Ofi 55 it; iivipped to old dei^tinatson B inode $9 (8 99) in map &. To make B the new 
des»$nat(on and A the nev^- »oiin;&, aii as^^iciative map is consxnu>ted with ihe process ex^ 
fiaciiiig A 87 and B 99 for U^e respective maps based npuji die common index OS 55. 
Tht associated map contains the new scurce/new destination entry $7/99, It. a^so incbdes 
the associated gei^^ration uumbers with diese values Item tiie old maps A and B. ISfott 
that, while the procedure is applied to two old destiiiatiora aysteT>is. it h contemt^ated that 
more ih»i\ two destination systems can be associated in various ways in acccfiiance Mth 
the techniques described herein. 

The mregoing has been a detail description of iliastraiiveemfradlments of the in- 
Ycction. Various modifications ajad additions csji be made without departing lonn the 
Spirit and scope of the invention. For cxantple^ the nuniber of interconnected source 
and/or defitination servers d(^picted can be varied. In facr, the source and destination 
servers can be the same machine, ft is exprci^ly conicniplated thai a pkimiit}' of sources 
cun transfer dat» to a destination and ^ice versa. Likewise, the hiteniat an:hitceU)Fc. of die 
servers or their respective storage aiTays, as well as their nel-^vork connectivity and proto- 
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cols, ar^ all highly miabie, Tbe operating sysldas used on vario\is source and destiDa- 
dou serv'eis csa\ differ. In addition, it h expi'cssly oont^nplateci tbat^i> of tiie oper&tsou^^ 
2iid nrocedures described herein caw be implemented using hacdwaie, $oft\^tu« coctipds*^ 
ioga cooxputer-i^adiible niediuix) havbg pto^m tnstrucuon^ executing on a cofriput«r, 
or a coinbiritidon of tiAniwaEre and solftwai^. 
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1. A system for identifyiivg changes in a logicnl of data biooks on a source and 
ttptlatiitg a replica of Che logical grcnip of data blocks on a descinatioi^ coaiprisiagi 

A) a scaitner <>pefative on a Ssiti sti of b!nck ideaiifi^ fliid a second set of 
block identifiers of a mat snapshot ai)u second snap-^hoi rc5tp«;tively, the fust STiapshot 
and the second snapshot each respc<;tiveiy corresponding to a different iniagp of the 
logical gTOiip erf datEi blocks with t]}^ lir.'it snapshot coirespondip^ to iht replica, the 
scapiier b^ig adapted t» seardi the secooid set of block identitlers f^^^ block idenufiers 
Dial differ from corresponding block identifiers of tfee fiiBt set of bJlock identifiers and 
thep^y indivate Changed datu blocks tliai are not. reflected in the replica; 

h) tran&-mtdjng the changed blocks to the destcnatiion without fransitattiiig all 
the blocks of the logical group; and 

C) updatijRg the I'epUca on the destination with the changed blocket. 

2. The &y$AAin of claiiit 1 * whtaretD tbo scanner is adapted to walk down a hifKrarchy of 
pointers associated with respective logical block indexes for ttte fiiat nod second 
snapshots and ideiuiiy pointed-to bbcks with changed b)ock identifiew relative to 
pointed-to blocks at oortesponding offsets while bypassing blocks havii^ undianged 
volvnie block numbet?. 

3. The syntem of <;lajm 1 further oompdUmg an toode piclcer tliat. picks out inodCft in 
the retrieved bloclcs having a prftdstermined associ;iiiion and that indicate chanftea 
between* rospocsivdy a fir^t version and a $econd version of tho inodes in the first 
^nap&Iiot aiid the second snapshot. 

4. The systettt of claim 3 . v/herein the piedeterisined association couipmes a sub- 
OTSanl/aiion of a vobme file $)'siein. 

5. The system of claim 4» wherein the sub-oi'^izntion comprises a q^troe within the 
volumes fde sys^JSL 
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6. The system of daiin 4 fmthtu coni|>nsing ft& inoc^ worto tbm opesiates on 
QueuAd blocks retrieved by ih& 'mode picker and that applies ihe scanner to derive 
chdinges betwciea l^ocks in a hierarciiy of che first version of essch of the pldsxd out 
inodcs witb it^pcct a hierarchy of the second vdrsiou of e;ach the picked out inodes. 

7 . Thic s)=^teni of claim wherein the ittcKle worker U adapted (o collect tbe change? 
an foL'Witfd tte chaiige>5 to a pipeline that packages the chaoocA in a data sireajoi for 
transiidfidjon to thf? descinationfiic system. 

8. The s>-stcni of claJbn 7 f unher comprising an cxtensibie and file syiifssai- 
indcrpen^fcnit liormat that tcani^imts tiio changes between the source file system and the 
destbatioik iilo itysteni, 

9. A method for iipdatuii; & replica of logical group of data blocks on a destinadon 
with chaflges i» a oone&nuTiding laical group oii a sottFce» comprising: 

A) compariog a first s/U of block identifiers of a fijst isnap^ioi of the logical 
group Oft the :iot»XA which correspODds to the repUca^ with a second set of block 
idendfiei::^ oi a secoiid ^mipshot of the logical gioup on the souroe to identify data blocks 
in oorresponding locations within the logical group that have changed; 

fi) transtnittiA^ the dianged blocks to the destination without transuiitring All 
the block:; ol the toxical group; an4 

C) updating the r^Uca on the destination with ihc irfiiu^iuttod changed blocks, 

to. The nierhod of cUIxd 9» wbefein the tir«t tmapshoc and second snapshot 
correspond to images of the logical group on the source at respective 5rst and second 
poinia in cinie^ and (he compasing step selects the corresponding block identifiers of the 
tkst and second $et of block identifiers tJiai have changed between the fntt and second 
points of !ijne. 

1 i. The method of daim lO^ wherein the logical group <m the source compilses a 
hiersirchicat arrangement, and the fust and second sei& of block identifieas each coinprise 
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a hicrarcliical hiock index cofresjponUing IjO the hierarchic^] airang^iDcnt, and ih* 
selecting step is f^^torxiicd by a scantiei: chat seacche^ and con^arcs the hietaidiical 
block indcAe^ to i^tif>' tii& changed blocks, 

12. ittemt^odot^ialm II, whm^n Che block idemlflmci'tiie linitand^^eccodseis 
of block id^iHtlers tcftx (o data biocU at corrtetpondifig locatioBS within tbc logica] 
group on th:& source, fiiid tiie seiecskng step setocts ehaitged blocks by comparing block 
identifieis of Hm> first and ses;oiKl sets of blocks idcntiGei's tl>ai refer to data blocks^ at tiie 
same locaiioas within the los^ical group. 

1 3. The mediod of. claim 9 fvctber conipf ising pickim^i oiu inode^s, v/ith an ioode 
picker, Izk tfao retiieved blocks Iitaving pix^lctermitted associsiion and indicatiDg cbaii,Se$ 
between. iespecd\'9ly a first version aiid a second vefsiou of the Imodes m tihe tot 
snapshot and the second anapsliot. 

14. The loetbud of claim ] 3, wherein die predetermiBed association comprltos a saxb- 
organization of a volume fitc system. 

15. Th& incihod of claim I4« wlien&in the stib-or^samxation comprises a qtree within 
ebe voluaie .{ile sytttein- 

16. A system for receiving a data .stream of diaxtges from a snapshot of a logics] 
group of data blocks on a .voui'c&aud tipdatit^g ^ replica of the logical group oti a 
destination, compri&ing: 

A) a rnetadata ^gr- process that read.s ineiadaea describing a siruaure lor the 
logical sniwp c» the source and tnap& references to the logical ^ncrup oit the «ouizce with 
references to the logical group on tl>c desUnation to identify chanj^ blocks; and 

&> a data stage process that, jn^sponivivc to the mapped feLfefence^*, populates the 
logical group iTn &e replica with data blocks from the soiirsze fliat have changed at 
cOTTespoaGing offsets in the logical group. 
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17. A system for idciiiifyirtg changes to a logical ^o\^^ of data blocks od a souECe ai^ 
upctataitg 9 replica of die lostical gruiiip on a dcsHnatioa« eompibLUg: 

A> a metadata stag^ process incLuding the steps of (i> fcadhig meouiaia descnbxihg 
a structure for the fogicaL group oix die (wurce; the izieiadatti iac)iicl<ag a fn-st i^et of 
TOt'eseiices to the data bloc^d cf the logical group on die source; and (li) gea^iatlng a 
c«plica of the read ractacUta, indudmg step ot nis^Jpiiig the fust set of refeapencca tjt) a 
second ser of referenced to data blocks of the lo^cal group On t^ie destinatiofi; acd 

B) a d&ia jCagc process responsive to the metadata ^ta^^e process incigdmg the 
step of pi^ulatiiig the replica witli data blocks rtl'ereoced by tbe second set of rcf ereuces. 

I $(. A method foe updating a replica on a des^tmatioA, compn^fjjg; 

A) ;eadjsi£» from c^ianj^ data of tht at^apshot* ideutifiers related to deleted ami 
modified lOgical groups of data on the veplica aiKl placiDg the deleicd and okodlfied 
logical g;Eoups in a tesaporary separate &om a iseairi store of the lepUca; 

6) cheating a sei of Tefersnccs in the mairt ^ore to the deleted and modified 
logical grouped la the: ttnipocary sttore; tuad 

C) after the cceathig atepi deallocating the temponuy store vk^le rnaimaijUHg the 
references k tbe main store (o the deteied and modified logical gmups of data. 

ABSTRACT OF THE »ISa.OSURE 

A system and me(kod for remote a^yEichroaoiM replication or microriog of 
cKaingds hi a aooxte file system snapshot in adestixuction replica fHe ^ly^tejn using a 3oaii 
(via a scanner) of the blocks that rnake up two venuons of a siiapsbot of the source Qle 
system, ^^hich idcxiti5es cltangod blocks in the respective snapshot files b?iscd upon dlf- 
fcronce$ ia volume block nvmbci's identified iu a scan of the logical file block index of 
each snapshot. Tnees of blocks associated with the files are travmed, bypassiog un- 
changed poititets betsveen versions and walking do^u to idcotify the changes in the hict * 
archy of &e tree. These dianges are trausmitted to the destmation minor or replicated 
snapshot. This tcclinique allows regular files, directories, jjiodes and any other hierarchi- 
cal atructure to be efficiently acannod to determine dil^tences between vejsrons fhoreof. 
The changes'^ In the files and ditectones are transmitted over the network for update of the 
replicatsd destination snapshot in an asyxichconous (lazy write} inajiner. llie changes arc 
deitcribed in an eictetmble, system-independent data atreain foixnat layered under a net- 
•wck transport protocol. At tlic destination, source chaiig^s arc uK^d to update tiic desti- 
nation snapshot Any deleted or modified inodes already on the destinattofi are moved to 
a tempox?ij7 "^itrgatoiy" directory ajid> if retised* are relinked to the rebiult replacaled 
snapshot directory. The souzce file $>'steiii snapshots ctm be repie^entative of a volume 
flub-organizction, soch as a qtree. 
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